[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:08 dist-test-slave-chsk krb5kdc[19773](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:08 dist-test-slave-chsk krb5kdc[19773](info): set up 2 sockets
Aug 05 22:37:08 dist-test-slave-chsk krb5kdc[19773](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260805 22:37:09.763675 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:09 dist-test-slave-chsk krb5kdc[19773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969429, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:09.920924 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:38777
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:38777
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:10.014467 19787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:10.014786 19787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:10.014832 19787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:10.016369 19787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:10.016448 19787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:10.016471 19787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:10.016494 19787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:10.016520 19787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:10.018503 19787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:38777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:38777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:10.018841 19787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:10.019119 19787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:10.024334 19796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:10.024561 19787 server_base.cc:1034] running on GCE node
W20260805 22:37:10.025610 19794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:10.025822 19793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:10.026127 19787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:10.026636 19787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:10.027801 19787 hybrid_clock.cc:648] HybridClock initialized: now 1785969430027785 us; error 70 us; skew 500 ppm
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:10.030953 19787 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:10.031692 19787 webserver.cc:460] Webserver started at http://127.19.77.190:46673/ using document root <none> and password file <none>
I20260805 22:37:10.031967 19787 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:10.032042 19787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:10.032222 19787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:10.033463 19787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "2857e2cd910646a2af048cbe38aebef6"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "1713d507581bc58a9d7ec1caf5b1cd60"
server_key_iv: "5c03865ac2805258daf443ee28b50563"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.033864 19787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "2857e2cd910646a2af048cbe38aebef6"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "1713d507581bc58a9d7ec1caf5b1cd60"
server_key_iv: "5c03865ac2805258daf443ee28b50563"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.035718 19787 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260805 22:37:10.036705 19803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:10.036999 19787 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:10.037135 19787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "2857e2cd910646a2af048cbe38aebef6"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "1713d507581bc58a9d7ec1caf5b1cd60"
server_key_iv: "5c03865ac2805258daf443ee28b50563"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.037226 19787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:10.053557 19787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:10.057315 19787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:10.057569 19787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:10.064186 19787 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:38777
I20260805 22:37:10.064224 19855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:38777 every 8 connection(s)
I20260805 22:37:10.064769 19787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:10.065924 19856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:10.068216 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 19787
I20260805 22:37:10.068395 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:10.069392 19766 external_mini_cluster.cc:1428] Setting key 3d39ff2d7231efa0b754ebe0df9be74a
I20260805 22:37:10.070322 19856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6: Bootstrap starting.
I20260805 22:37:10.071859 19856 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:10.072691 19856 log.cc:824] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:10.073699 19856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6: No bootstrap required, opened a new log
I20260805 22:37:10.078150 19856 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2857e2cd910646a2af048cbe38aebef6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38777 } }
I20260805 22:37:10.078536 19856 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:10.078604 19856 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2857e2cd910646a2af048cbe38aebef6, State: Initialized, Role: FOLLOWER
I20260805 22:37:10.078826 19856 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2857e2cd910646a2af048cbe38aebef6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38777 } }
I20260805 22:37:10.079006 19856 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:10.079062 19856 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:10.079123 19856 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:10.080861 19856 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2857e2cd910646a2af048cbe38aebef6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38777 } }
I20260805 22:37:10.081065 19856 leader_election.cc:302] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2857e2cd910646a2af048cbe38aebef6; no voters:
I20260805 22:37:10.081382 19856 leader_election.cc:288] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:10.081465 19861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:10.081651 19861 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [term 1 LEADER]: Becoming Leader. State: Replica: 2857e2cd910646a2af048cbe38aebef6, State: Running, Role: LEADER
I20260805 22:37:10.081727 19856 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:10.081808 19861 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2857e2cd910646a2af048cbe38aebef6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38777 } }
I20260805 22:37:10.082301 19862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2857e2cd910646a2af048cbe38aebef6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2857e2cd910646a2af048cbe38aebef6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38777 } } }
I20260805 22:37:10.082394 19862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:10.083673 19863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2857e2cd910646a2af048cbe38aebef6. Latest consensus state: current_term: 1 leader_uuid: "2857e2cd910646a2af048cbe38aebef6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2857e2cd910646a2af048cbe38aebef6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38777 } } }
I20260805 22:37:10.083765 19863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:10.084350 19867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:10.085161 19867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:10.087739 19867 catalog_manager.cc:1347] Generated new cluster ID: 013996711de241cd9f1e242d2a66985e
I20260805 22:37:10.087823 19867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969429, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:10.095806 19859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:10.070702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38444 (local address 127.19.77.190:38777)
0805 22:37:10.071172 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:10.071181 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:10.071342 (+ 161us) server_negotiation.cc:407] Connection header received
0805 22:37:10.075915 (+ 4573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:10.075924 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:10.075986 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:10.076158 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:10.078148 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.079890 (+ 1742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.082163 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.082979 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.083108 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:10.089349 (+ 6241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:10.089356 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:10.089357 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:10.089379 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:10.092661 (+ 3282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.093489 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.093494 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.093495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.093643 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.093942 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.093943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.093943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.094229 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:10.095100 (+ 871us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:10.095330 (+ 230us) server_negotiation.cc:299] Negotiation successful
0805 22:37:10.095580 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":288,"threads_started":1}
I20260805 22:37:10.118417 19867 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:10.119477 19867 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:10.130657 19867 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2857e2cd910646a2af048cbe38aebef6: Generated new TSK 0
I20260805 22:37:10.130911 19867 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:37:10.171444 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38777
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:10.307804 19882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:10.308063 19882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:10.308094 19882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:10.309653 19882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:10.309724 19882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:10.309760 19882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:10.311759 19882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38777
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:10.312007 19882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:10.312239 19882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:10.320951 19888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:10.321031 19887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:10.321115 19890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:10.321429 19882 server_base.cc:1034] running on GCE node
I20260805 22:37:10.321659 19882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:10.321988 19882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:10.323244 19882 hybrid_clock.cc:648] HybridClock initialized: now 1785969430323223 us; error 43 us; skew 500 ppm
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:10.330941 19882 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:37:10.331607 19882 webserver.cc:460] Webserver started at http://127.19.77.129:40491/ using document root <none> and password file <none>
I20260805 22:37:10.331924 19882 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:10.332006 19882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:10.332180 19882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:10.333578 19882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "ed56c30043a64a07a4d31ae6f690452a"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "5a8b97421376ab231ef8fe435d584c5c"
server_key_iv: "7a49c8b9fbbbaeb255d656b5067c87a0"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.334113 19882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "ed56c30043a64a07a4d31ae6f690452a"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "5a8b97421376ab231ef8fe435d584c5c"
server_key_iv: "7a49c8b9fbbbaeb255d656b5067c87a0"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.336113 19882 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260805 22:37:10.337548 19897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:10.337807 19882 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:10.337931 19882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "ed56c30043a64a07a4d31ae6f690452a"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "5a8b97421376ab231ef8fe435d584c5c"
server_key_iv: "7a49c8b9fbbbaeb255d656b5067c87a0"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.338021 19882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:10.351854 19882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:10.355386 19882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:10.355660 19882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:10.356096 19882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:10.356557 19882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:10.356619 19882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:10.356657 19882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:10.356705 19882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:10.374248 19882 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:41901
I20260805 22:37:10.374547 20013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:41901 every 8 connection(s)
I20260805 22:37:10.375108 19882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:10.380820 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 19882
I20260805 22:37:10.380944 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:10.381106 19766 external_mini_cluster.cc:1428] Setting key 70a1bd68395c810934d2d46977726676
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:10.389904 19859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:10.376538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:36671 (local address 127.19.77.190:38777)
0805 22:37:10.376652 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:10.376654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:10.377124 (+ 470us) server_negotiation.cc:407] Connection header received
0805 22:37:10.378040 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:10.378042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:10.378057 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:10.378100 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:10.379532 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.380066 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.381726 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.382177 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.382425 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:10.386245 (+ 3820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:10.386247 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:10.386248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:10.386257 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:10.387906 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.388644 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.388645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.388645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.388708 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.389046 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.389046 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.389047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.389170 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:10.389338 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:10.389733 (+ 395us) server_negotiation.cc:299] Negotiation successful
0805 22:37:10.389827 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 22:37:10.390362 20016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:10.376502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38777 (local address 127.19.77.129:36671)
0805 22:37:10.376942 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:10.376983 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:10.377901 (+ 918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:10.378194 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:10.378197 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:10.379038 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:10.379415 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:10.379423 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.380192 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.380193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:10.381623 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:10.381626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.382528 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.382530 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:10.382922 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:10.383879 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:10.383889 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:10.386117 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:10.388074 (+ 1957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:10.388090 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:10.388094 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:10.388534 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:10.388784 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:10.388785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:10.388785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:10.388960 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:10.389263 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:10.389271 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:10.389486 (+ 215us) client_negotiation.cc:769] Sending connection context
0805 22:37:10.389686 (+ 200us) client_negotiation.cc:240] Negotiation successful
0805 22:37:10.389935 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":209,"threads_started":1}
I20260805 22:37:10.391080 20014 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38777
I20260805 22:37:10.391266 20014 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:10.391516 20014 heartbeater.cc:511] Master 127.19.77.190:38777 requested a full tablet report, sending...
I20260805 22:37:10.392143 19820 ts_manager.cc:194] Registered new tserver with Master: ed56c30043a64a07a4d31ae6f690452a (127.19.77.129:41901)
I20260805 22:37:10.392822 19820 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:36671
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:37:10.419699 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38777
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:10.542574 20020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:10.542871 20020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:10.542905 20020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:10.544330 20020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:10.544386 20020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:10.544417 20020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:10.546648 20020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38777
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:10.546990 20020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:10.547317 20020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:10.553817 20028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:10.553897 20026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:10.553920 20025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:10.554104 20020 server_base.cc:1034] running on GCE node
I20260805 22:37:10.554536 20020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:10.554852 20020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:10.556023 20020 hybrid_clock.cc:648] HybridClock initialized: now 1785969430555922 us; error 118 us; skew 500 ppm
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:10.559520 20020 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:37:10.560153 20020 webserver.cc:460] Webserver started at http://127.19.77.130:45527/ using document root <none> and password file <none>
I20260805 22:37:10.560423 20020 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:10.560498 20020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:10.560665 20020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:10.561830 20020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "a59bca7a6365425d9512290c31de01c4"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "f0975a7ed5bd55057af9fc596b6ffbcb"
server_key_iv: "cace8d5d9f492cb42540dcf281e55b1c"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.562285 20020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "a59bca7a6365425d9512290c31de01c4"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "f0975a7ed5bd55057af9fc596b6ffbcb"
server_key_iv: "cace8d5d9f492cb42540dcf281e55b1c"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.563966 20020 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:37:10.565058 20035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:10.565438 20020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:10.565583 20020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "a59bca7a6365425d9512290c31de01c4"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "f0975a7ed5bd55057af9fc596b6ffbcb"
server_key_iv: "cace8d5d9f492cb42540dcf281e55b1c"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.565670 20020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:10.574972 20020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:10.578373 20020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:10.578908 20020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:10.579530 20020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:10.579936 20020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:10.579996 20020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:10.580041 20020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:10.580070 20020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:10.596411 20020 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:41193
I20260805 22:37:10.596593 20155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:41193 every 8 connection(s)
I20260805 22:37:10.596798 20020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:10.597270 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 20020
I20260805 22:37:10.597358 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:10.597517 19766 external_mini_cluster.cc:1428] Setting key dabd7054ff977f2f50d3d6734145d1e1
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
I20260805 22:37:10.610821 19859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:10.597744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:60085 (local address 127.19.77.190:38777)
0805 22:37:10.597797 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:10.597799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:10.598379 (+ 580us) server_negotiation.cc:407] Connection header received
0805 22:37:10.599630 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:10.599631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:10.599643 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:10.599711 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:10.601577 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.602103 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.603395 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.603682 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.603774 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:10.606915 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:10.606917 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:10.606917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:10.606925 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:10.608563 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.609160 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.609162 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.609162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.609241 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.609644 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.609646 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.609647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.609981 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:10.610130 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:10.610594 (+ 464us) server_negotiation.cc:299] Negotiation successful
0805 22:37:10.610730 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:37:10.610855 20158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:10.597736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38777 (local address 127.19.77.130:60085)
0805 22:37:10.598191 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:10.598239 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:10.599460 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:10.599796 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:10.599800 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:10.600950 (+ 1150us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:10.601445 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:10.601452 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.602209 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.602210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:10.603302 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:10.603304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.603788 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.603789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:10.603979 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:10.604755 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:10.604764 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:10.606768 (+ 2004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:10.608687 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:10.608698 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:10.608701 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:10.609040 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:10.609326 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:10.609327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:10.609328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:10.609492 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:10.610181 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:10.610188 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:10.610395 (+ 207us) client_negotiation.cc:769] Sending connection context
0805 22:37:10.610503 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 22:37:10.610658 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":300,"threads_started":1}
I20260805 22:37:10.611882 20156 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38777
I20260805 22:37:10.612015 20156 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:10.612278 20156 heartbeater.cc:511] Master 127.19.77.190:38777 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
I20260805 22:37:10.612818 19820 ts_manager.cc:194] Registered new tserver with Master: a59bca7a6365425d9512290c31de01c4 (127.19.77.130:41193)
I20260805 22:37:10.613375 19820 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:60085
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:37:10.634224 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38777
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:10.757766 20161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:10.758039 20161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:10.758095 20161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:10.759593 20161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:10.759665 20161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:10.759717 20161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:10.763019 20161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38777
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:10.763505 20161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:10.763942 20161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:10.772953 20166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:10.773008 20167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:10.773221 20161 server_base.cc:1034] running on GCE node
W20260805 22:37:10.773392 20169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:10.773626 20161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:10.773900 20161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:10.775122 20161 hybrid_clock.cc:648] HybridClock initialized: now 1785969430775101 us; error 34 us; skew 500 ppm
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:10.777890 20161 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:37:10.778520 20161 webserver.cc:460] Webserver started at http://127.19.77.131:37921/ using document root <none> and password file <none>
I20260805 22:37:10.778776 20161 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:10.778851 20161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:10.779011 20161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:10.780294 20161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "b3c7f9e724064fc2974dc63a9032eb98"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "063e62cec9851c81ac1f34b2cd6a0c9d"
server_key_iv: "60ebe207f4a7b6550f865d8e6790c873"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.780747 20161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "b3c7f9e724064fc2974dc63a9032eb98"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "063e62cec9851c81ac1f34b2cd6a0c9d"
server_key_iv: "60ebe207f4a7b6550f865d8e6790c873"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.782562 20161 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260805 22:37:10.783650 20176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:10.783882 20161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:37:10.784006 20161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "b3c7f9e724064fc2974dc63a9032eb98"
format_stamp: "Formatted at 2026-08-05 22:37:10 on dist-test-slave-chsk"
server_key: "063e62cec9851c81ac1f34b2cd6a0c9d"
server_key_iv: "60ebe207f4a7b6550f865d8e6790c873"
server_key_version: "encryptionkey@0"
I20260805 22:37:10.784108 20161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:10.792110 20161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:10.794174 20161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:10.794353 20161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:10.794605 20161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:10.794941 20161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:10.794999 20161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:10.795070 20161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:10.795102 20161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:10.808180 20161 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:39247
I20260805 22:37:10.808245 20293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:39247 every 8 connection(s)
I20260805 22:37:10.808758 20161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:37:10.811414 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 20161
I20260805 22:37:10.811538 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:10.811746 19766 external_mini_cluster.cc:1428] Setting key 2c1448e4e3af36ab86351e98e74026b7
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:10.821157 19859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:10.809746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:36435 (local address 127.19.77.190:38777)
0805 22:37:10.809812 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:10.809814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:10.810148 (+ 334us) server_negotiation.cc:407] Connection header received
0805 22:37:10.810832 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:10.810833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:10.810847 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:10.810898 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:10.812549 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.813307 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.814456 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.814655 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.814715 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:10.817903 (+ 3188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:10.817905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:10.817905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:10.817914 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:10.819439 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.819896 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.819897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.819898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.819976 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.820443 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.820444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.820444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.820578 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:10.820651 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:10.820991 (+ 340us) server_negotiation.cc:299] Negotiation successful
0805 22:37:10.821067 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:37:10.821419 20296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:10.809741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38777 (local address 127.19.77.131:36435)
0805 22:37:10.810014 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:10.810054 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:10.810705 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:10.810975 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:10.810980 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:10.811983 (+ 1003us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:10.812399 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:10.812407 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.813416 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.813416 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:10.814356 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:10.814359 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.814743 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.814744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:10.814907 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:10.815705 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:10.815720 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:10.817798 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:10.819520 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:10.819528 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:10.819530 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:10.819798 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:10.820130 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:10.820132 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:10.820133 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:10.820350 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:10.820680 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:10.820686 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:10.820829 (+ 143us) client_negotiation.cc:769] Sending connection context
0805 22:37:10.820927 (+ 98us) client_negotiation.cc:240] Negotiation successful
0805 22:37:10.821086 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":152,"threads_started":1}
I20260805 22:37:10.822132 20294 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38777
I20260805 22:37:10.822235 20294 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:10.822400 20294 heartbeater.cc:511] Master 127.19.77.190:38777 requested a full tablet report, sending...
I20260805 22:37:10.822836 19820 ts_manager.cc:194] Registered new tserver with Master: b3c7f9e724064fc2974dc63a9032eb98 (127.19.77.131:39247)
I20260805 22:37:10.823645 19820 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:36435
I20260805 22:37:10.824378 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:37:10.855914 20301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:10.845355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55232 (local address 127.19.77.129:41901)
0805 22:37:10.845514 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:10.845522 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:10.845614 (+ 92us) server_negotiation.cc:407] Connection header received
0805 22:37:10.845693 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:10.845696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:10.845719 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:10.845805 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:10.846633 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.847626 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.848390 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.848808 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.848902 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:10.851542 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:10.851570 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:10.851570 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:10.851578 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:10.854127 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.854827 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.854835 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.854835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.854921 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.855213 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.855214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.855214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.855404 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:10.855600 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:10.855658 (+ 58us) server_negotiation.cc:299] Negotiation successful
0805 22:37:10.855764 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
W20260805 22:37:10.856534 19928 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55232
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[19773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:37:10.885859 20301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:10.876377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55236 (local address 127.19.77.129:41901)
0805 22:37:10.876495 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:10.876498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:10.876692 (+ 194us) server_negotiation.cc:407] Connection header received
0805 22:37:10.876805 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:10.876807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:10.876826 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:10.876902 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:10.877559 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.878154 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.878928 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:10.879360 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:10.879454 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:10.882599 (+ 3145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:10.882600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:10.882600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:10.882608 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:10.884567 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.884997 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.884998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.884998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.885065 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:10.885281 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:10.885282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:10.885283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:10.885403 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:10.885619 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:10.885658 (+ 39us) server_negotiation.cc:299] Negotiation successful
0805 22:37:10.885745 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 22:37:10.886540 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 19882
I20260805 22:37:10.893533 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 20020
I20260805 22:37:10.901633 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 20161
I20260805 22:37:10.908797 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 19787
2026-08-05T22:37:10Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2251 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[20309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[20309](info): set up 2 sockets
Aug 05 22:37:10 dist-test-slave-chsk krb5kdc[20309](info): commencing operation
krb5kdc: starting...
W20260805 22:37:11.978996 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:12.123610 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:42213
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:44179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:42213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:12.211792 20322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:12.212070 20322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:12.212112 20322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:12.213322 20322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:12.213446 20322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:12.213472 20322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:12.213491 20322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:12.213521 20322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:12.215193 20322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:44179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:42213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:42213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:12.215515 20322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:12.215773 20322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:12.221124 20327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:12.221104 20331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:12.221100 20328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:12.221470 20322 server_base.cc:1034] running on GCE node
I20260805 22:37:12.221745 20322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:12.222083 20322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:12.223246 20322 hybrid_clock.cc:648] HybridClock initialized: now 1785969432223233 us; error 33 us; skew 500 ppm
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:12.226037 20322 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:12.226594 20322 webserver.cc:460] Webserver started at http://127.19.77.190:36033/ using document root <none> and password file <none>
I20260805 22:37:12.226854 20322 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:12.226929 20322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:12.227090 20322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:12.228232 20322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "f7c9d72505cd48288840febbb2274a79"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "b7679526cdba663a2f51dea782ccd55d"
server_key_iv: "fe0a5049d6061e27c93210c22c8ba437"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.228624 20322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "f7c9d72505cd48288840febbb2274a79"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "b7679526cdba663a2f51dea782ccd55d"
server_key_iv: "fe0a5049d6061e27c93210c22c8ba437"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.230257 20322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:37:12.231735 20338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:12.231982 20322 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260805 22:37:12.232141 20322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "f7c9d72505cd48288840febbb2274a79"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "b7679526cdba663a2f51dea782ccd55d"
server_key_iv: "fe0a5049d6061e27c93210c22c8ba437"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.232251 20322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:12.244692 20322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:12.247263 20322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:12.247437 20322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:12.251884 20322 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:42213
I20260805 22:37:12.252331 20322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:12.252543 20392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:42213 every 8 connection(s)
I20260805 22:37:12.253304 20393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:12.255981 20393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79: Bootstrap starting.
I20260805 22:37:12.256659 20393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:12.256981 20393 log.cc:824] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:12.257794 20393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79: No bootstrap required, opened a new log
I20260805 22:37:12.259716 20393 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c9d72505cd48288840febbb2274a79" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42213 } }
I20260805 22:37:12.259899 20393 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:12.259956 20393 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c9d72505cd48288840febbb2274a79, State: Initialized, Role: FOLLOWER
I20260805 22:37:12.260149 20393 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c9d72505cd48288840febbb2274a79" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42213 } }
I20260805 22:37:12.260198 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 20322
I20260805 22:37:12.260243 20393 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:12.260298 20393 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:12.260306 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:12.260353 20393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:12.260489 19766 external_mini_cluster.cc:1428] Setting key 9d4dbf0ce7904c10057bf48da8e6ff77
I20260805 22:37:12.261263 20393 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c9d72505cd48288840febbb2274a79" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42213 } }
I20260805 22:37:12.261400 20393 leader_election.cc:302] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7c9d72505cd48288840febbb2274a79; no voters:
I20260805 22:37:12.261658 20393 leader_election.cc:288] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:12.261721 20398 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:12.261888 20398 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [term 1 LEADER]: Becoming Leader. State: Replica: f7c9d72505cd48288840febbb2274a79, State: Running, Role: LEADER
I20260805 22:37:12.261974 20393 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:12.262024 20398 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c9d72505cd48288840febbb2274a79" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42213 } }
I20260805 22:37:12.262501 20399 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7c9d72505cd48288840febbb2274a79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c9d72505cd48288840febbb2274a79" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42213 } } }
I20260805 22:37:12.262488 20400 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7c9d72505cd48288840febbb2274a79. Latest consensus state: current_term: 1 leader_uuid: "f7c9d72505cd48288840febbb2274a79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c9d72505cd48288840febbb2274a79" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42213 } } }
I20260805 22:37:12.262588 20399 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:12.262595 20400 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:12.263407 20403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:12.263959 20403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:12.265568 20403 catalog_manager.cc:1347] Generated new cluster ID: f49bef0467ec41ce910cf816367cd2bf
I20260805 22:37:12.265623 20403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:12.275068 20397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.261463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60204 (local address 127.19.77.190:42213)
0805 22:37:12.261691 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.261703 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.261747 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:37:12.261888 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.261896 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.261977 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.263096 (+ 1119us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:12.263255 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.264910 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.266118 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.266740 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.266847 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.269946 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:12.269952 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:12.269953 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:12.269969 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:12.273161 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.273628 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.273632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.273633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.273759 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.274015 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.274016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.274016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.274349 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:12.274510 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.274681 (+ 171us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.274832 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":112,"threads_started":1}
I20260805 22:37:12.282042 20403 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:12.282632 20403 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:12.287067 20403 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7c9d72505cd48288840febbb2274a79: Generated new TSK 0
I20260805 22:37:12.287348 20403 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:37:12.322844 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42213
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:44179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:12.432673 20420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:12.432900 20420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:12.432928 20420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:12.434177 20420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:12.434223 20420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:12.434252 20420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:12.435917 20420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:44179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42213
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:12.436178 20420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:12.436426 20420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:12.442299 20426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:12.442279 20425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:12.442281 20428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:12.442652 20420 server_base.cc:1034] running on GCE node
I20260805 22:37:12.442854 20420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:12.443074 20420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:12.444285 20420 hybrid_clock.cc:648] HybridClock initialized: now 1785969432444274 us; error 29 us; skew 500 ppm
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:12.447016 20420 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:37:12.447575 20420 webserver.cc:460] Webserver started at http://127.19.77.129:39329/ using document root <none> and password file <none>
I20260805 22:37:12.447796 20420 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:12.447839 20420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:12.447935 20420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:12.448987 20420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "a90bfa6cb28b4f039f991b3e8bddc979"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "8bb162957cc83a4c8d8002f939738a0a"
server_key_iv: "11124fa6f32b0465049c98636b5690f6"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.449306 20420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "a90bfa6cb28b4f039f991b3e8bddc979"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "8bb162957cc83a4c8d8002f939738a0a"
server_key_iv: "11124fa6f32b0465049c98636b5690f6"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.450764 20420 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:37:12.451712 20435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:12.451923 20420 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:37:12.452039 20420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "a90bfa6cb28b4f039f991b3e8bddc979"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "8bb162957cc83a4c8d8002f939738a0a"
server_key_iv: "11124fa6f32b0465049c98636b5690f6"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.452127 20420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:12.463618 20420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:12.466022 20420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:12.466198 20420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:12.466493 20420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:12.466828 20420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:12.466882 20420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:12.466926 20420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:12.466952 20420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:12.473402 20420 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:39087
I20260805 22:37:12.473445 20552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:39087 every 8 connection(s)
I20260805 22:37:12.473799 20420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:12.480048 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 20420
I20260805 22:37:12.480193 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:12.480372 19766 external_mini_cluster.cc:1428] Setting key a19b48bf56e21066a7aa28d31359a020
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:12.485531 20397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.474637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:46287 (local address 127.19.77.190:42213)
0805 22:37:12.474735 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.474737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.475088 (+ 351us) server_negotiation.cc:407] Connection header received
0805 22:37:12.476136 (+ 1048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.476138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.476150 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.476214 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:12.476976 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.477747 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.478842 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.479068 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.479205 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.481930 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:12.481933 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:12.481933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:12.481955 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:12.483903 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.484388 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.484390 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.484390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.484454 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.484845 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.484845 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.484846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.484965 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:12.485043 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.485339 (+ 296us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.485438 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260805 22:37:12.485785 20555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.474579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42213 (local address 127.19.77.129:46287)
0805 22:37:12.474764 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:12.474803 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:12.475965 (+ 1162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:12.476296 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:12.476300 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:12.476575 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:12.476792 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.476795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.477857 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.477858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.478736 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.478738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.479238 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.479240 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.479359 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.480017 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:12.480026 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:12.481817 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:12.484015 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:12.484028 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:12.484030 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:12.484291 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:12.484571 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:12.484572 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:12.484572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:12.484735 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:12.485034 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:12.485042 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:12.485191 (+ 149us) client_negotiation.cc:769] Sending connection context
0805 22:37:12.485305 (+ 114us) client_negotiation.cc:240] Negotiation successful
0805 22:37:12.485484 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":102,"threads_started":1}
I20260805 22:37:12.486568 20553 heartbeater.cc:347] Connected to a master server at 127.19.77.190:42213
I20260805 22:37:12.486699 20553 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:12.486927 20553 heartbeater.cc:511] Master 127.19.77.190:42213 requested a full tablet report, sending...
I20260805 22:37:12.487596 20355 ts_manager.cc:194] Registered new tserver with Master: a90bfa6cb28b4f039f991b3e8bddc979 (127.19.77.129:39087)
I20260805 22:37:12.488279 20355 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:46287
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:37:12.512773 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42213
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:44179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:12.604414 20558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:12.604661 20558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:12.604689 20558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:12.605962 20558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:12.606015 20558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:12.606045 20558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:12.607769 20558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:44179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42213
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:12.608040 20558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:12.608300 20558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:12.613693 20563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:12.613940 20558 server_base.cc:1034] running on GCE node
W20260805 22:37:12.613708 20566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:12.613710 20564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:12.614296 20558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:12.614583 20558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:12.615794 20558 hybrid_clock.cc:648] HybridClock initialized: now 1785969432615776 us; error 36 us; skew 500 ppm
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:12.618574 20558 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:37:12.619109 20558 webserver.cc:460] Webserver started at http://127.19.77.130:40837/ using document root <none> and password file <none>
I20260805 22:37:12.619390 20558 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:12.619465 20558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:12.619625 20558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:12.620721 20558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "79d6d1659cd74e8ab96505194d3f1ead"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "4eba6cd968484f5a2177bb8db70e37df"
server_key_iv: "ed2c167deaf119ff17a96f0bc3dc6111"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.621097 20558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "79d6d1659cd74e8ab96505194d3f1ead"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "4eba6cd968484f5a2177bb8db70e37df"
server_key_iv: "ed2c167deaf119ff17a96f0bc3dc6111"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.622686 20558 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:12.623975 20573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:12.624217 20558 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:12.624349 20558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "79d6d1659cd74e8ab96505194d3f1ead"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "4eba6cd968484f5a2177bb8db70e37df"
server_key_iv: "ed2c167deaf119ff17a96f0bc3dc6111"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.624440 20558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:12.631613 20558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:12.633850 20558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:12.634039 20558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:12.634299 20558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:12.634636 20558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:12.634696 20558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:12.634760 20558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:12.634796 20558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:12.641307 20558 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:41455
I20260805 22:37:12.641351 20687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:41455 every 8 connection(s)
I20260805 22:37:12.641682 20558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:12.649354 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 20558
I20260805 22:37:12.649473 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:12.649670 19766 external_mini_cluster.cc:1428] Setting key 649046f3426265700b5d91a79d241df5
I20260805 22:37:12.652294 20397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.642442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:36185 (local address 127.19.77.190:42213)
0805 22:37:12.642492 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.642494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.642754 (+ 260us) server_negotiation.cc:407] Connection header received
0805 22:37:12.643824 (+ 1070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.643825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.643841 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.643893 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:12.644607 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.645136 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.646183 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.646385 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.646475 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.648823 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:12.648824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:12.648824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:12.648831 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:12.650468 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.651020 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.651021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.651021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.651098 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.651475 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.651476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.651476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.651596 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:12.651655 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.652034 (+ 379us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.652163 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:37:12.652468 20690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.642400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42213 (local address 127.19.77.130:36185)
0805 22:37:12.642593 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:12.642662 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:12.643695 (+ 1033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:12.643963 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:12.643967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:12.644302 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:12.644506 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.644510 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.645242 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.645243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.646071 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.646073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.646489 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.646489 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.646625 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.647237 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:12.647246 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:12.648709 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:12.650556 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:12.650565 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:12.650568 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:12.650917 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:12.651253 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:12.651254 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:12.651254 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:12.651405 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:12.651671 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:12.651678 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:12.651859 (+ 181us) client_negotiation.cc:769] Sending connection context
0805 22:37:12.651981 (+ 122us) client_negotiation.cc:240] Negotiation successful
0805 22:37:12.652187 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
I20260805 22:37:12.653039 20688 heartbeater.cc:347] Connected to a master server at 127.19.77.190:42213
I20260805 22:37:12.653159 20688 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:12.653398 20688 heartbeater.cc:511] Master 127.19.77.190:42213 requested a full tablet report, sending...
I20260805 22:37:12.653828 20355 ts_manager.cc:194] Registered new tserver with Master: 79d6d1659cd74e8ab96505194d3f1ead (127.19.77.130:41455)
I20260805 22:37:12.654229 20355 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:36185
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:37:12.679474 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42213
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:44179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:12.775767 20694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:12.776036 20694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:12.776080 20694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:12.777329 20694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:12.777403 20694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:12.777479 20694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:12.779106 20694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:44179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42213
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:12.779457 20694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:12.779718 20694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:12.785351 20703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:12.785331 20700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:12.785352 20701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:12.786478 20694 server_base.cc:1034] running on GCE node
I20260805 22:37:12.786944 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:12.787487 20694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:12.788769 20694 hybrid_clock.cc:648] HybridClock initialized: now 1785969432788746 us; error 48 us; skew 500 ppm
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:12.791749 20694 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:37:12.792382 20694 webserver.cc:460] Webserver started at http://127.19.77.131:34299/ using document root <none> and password file <none>
I20260805 22:37:12.792656 20694 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:12.792732 20694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:12.792897 20694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:12.794011 20694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "ada6ac543a474651bf85659c447dca63"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "b401d1df4329941b6c3a13efb5b3cf84"
server_key_iv: "6a78498dbc09b403e377937945db9f38"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.794477 20694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "ada6ac543a474651bf85659c447dca63"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "b401d1df4329941b6c3a13efb5b3cf84"
server_key_iv: "6a78498dbc09b403e377937945db9f38"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.796469 20694 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260805 22:37:12.797435 20710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:12.797749 20694 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:12.797885 20694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "ada6ac543a474651bf85659c447dca63"
format_stamp: "Formatted at 2026-08-05 22:37:12 on dist-test-slave-chsk"
server_key: "b401d1df4329941b6c3a13efb5b3cf84"
server_key_iv: "6a78498dbc09b403e377937945db9f38"
server_key_version: "encryptionkey@0"
I20260805 22:37:12.797976 20694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:12.809464 20694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:12.812512 20694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:12.812709 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:12.812985 20694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:12.813350 20694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:12.813411 20694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:12.813481 20694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:12.813504 20694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:12.820302 20694 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:41199
I20260805 22:37:12.820371 20823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:41199 every 8 connection(s)
I20260805 22:37:12.820766 20694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:37:12.827364 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 20694
I20260805 22:37:12.827491 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:12.827661 19766 external_mini_cluster.cc:1428] Setting key 9e2bfbf56903be31461039c59f99e5ae
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:12.832582 20397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.821702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:47311 (local address 127.19.77.190:42213)
0805 22:37:12.821824 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.821827 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.822013 (+ 186us) server_negotiation.cc:407] Connection header received
0805 22:37:12.823035 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.823036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.823050 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.823100 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:12.823817 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.824325 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.825389 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.825603 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.825682 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.828926 (+ 3244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:12.828928 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:12.828928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:12.828935 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:12.830715 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.831347 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.831350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.831350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.831449 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.831821 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.831823 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.831823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.831965 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:12.832025 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.832382 (+ 357us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.832495 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260805 22:37:12.832643 20826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.821612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42213 (local address 127.19.77.131:47311)
0805 22:37:12.821859 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:12.821909 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:12.822904 (+ 995us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:12.823207 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:12.823211 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:12.823505 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:12.823708 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.823712 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.824427 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.824428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.825279 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.825281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.825693 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.825694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.825822 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.826582 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:12.826590 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:12.828823 (+ 2233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:12.830814 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:12.830822 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:12.830824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:12.831105 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:12.831568 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:12.831569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:12.831569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:12.831697 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:12.832036 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:12.832042 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:12.832199 (+ 157us) client_negotiation.cc:769] Sending connection context
0805 22:37:12.832300 (+ 101us) client_negotiation.cc:240] Negotiation successful
0805 22:37:12.832444 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":98,"threads_started":1}
I20260805 22:37:12.833304 20824 heartbeater.cc:347] Connected to a master server at 127.19.77.190:42213
I20260805 22:37:12.833453 20824 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:12.833670 20824 heartbeater.cc:511] Master 127.19.77.190:42213 requested a full tablet report, sending...
I20260805 22:37:12.834132 20355 ts_manager.cc:194] Registered new tserver with Master: ada6ac543a474651bf85659c447dca63 (127.19.77.131:41199)
I20260805 22:37:12.834687 20355 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:47311
I20260805 22:37:12.840428 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:37:12.849833 20397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.842287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60220 (local address 127.19.77.190:42213)
0805 22:37:12.842345 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.842347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.842470 (+ 123us) server_negotiation.cc:407] Connection header received
0805 22:37:12.842514 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.842514 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.842525 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.842577 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:12.843215 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.843761 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.844510 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.844701 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.844768 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.846418 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:12.846420 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:12.846420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:12.846428 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:12.848122 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.848557 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.848558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.848558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.848612 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.848854 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.848856 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.848857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.849119 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:12.849261 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.849485 (+ 224us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.849662 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:37:12.853078 20355 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:12.855367 20355 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:12.862944 20840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.858163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:41199 (local address 127.0.0.1:46958)
0805 22:37:12.858692 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:12.858704 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:12.858773 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:12.859227 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:12.859228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:12.859230 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:12.859276 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.859278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.860349 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.860350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.861807 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.861810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.862566 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.862567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.862685 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.862707 (+ 22us) client_negotiation.cc:769] Sending connection context
0805 22:37:12.862799 (+ 92us) client_negotiation.cc:240] Negotiation successful
0805 22:37:12.862858 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":75,"thread_start_us":185,"threads_started":1}
I20260805 22:37:12.862948 20838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.858301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46958 (local address 127.19.77.131:41199)
0805 22:37:12.858592 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.858596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.858836 (+ 240us) server_negotiation.cc:407] Connection header received
0805 22:37:12.858877 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.858880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.858897 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.859067 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:12.859346 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.860188 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.861916 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.862473 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.862566 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.862639 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.862820 (+ 181us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.862861 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":113,"threads_started":1}
I20260805 22:37:12.863394 20841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.858803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36518 (local address 127.19.77.129:39087)
0805 22:37:12.859010 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.859111 (+ 101us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.859123 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:37:12.859195 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.859197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.859214 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.859291 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:12.859560 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.860633 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.861872 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.862868 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.862992 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.863047 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.863268 (+ 221us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.863318 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":100,"threads_started":1}
I20260805 22:37:12.863626 20836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.858484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:39087 (local address 127.0.0.1:36518)
0805 22:37:12.858979 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:12.858990 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:12.859032 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:12.859382 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:12.859383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:12.859385 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:12.859454 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.859455 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.860813 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.860814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.861784 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.861787 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.863074 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.863075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.863190 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.863194 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:12.863250 (+ 56us) client_negotiation.cc:240] Negotiation successful
0805 22:37:12.863547 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":145,"threads_started":1}
I20260805 22:37:12.863873 20837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.858163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:41455 (local address 127.0.0.1:37864)
0805 22:37:12.858425 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:12.858468 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:12.858554 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:12.858960 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:12.858963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:12.858967 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:12.859051 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.859053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.860444 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.860445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.861917 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.861919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.862995 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.862996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.863591 (+ 595us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.863596 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:37:12.863648 (+ 52us) client_negotiation.cc:240] Negotiation successful
0805 22:37:12.863688 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":38,"thread_start_us":70,"threads_started":1}
I20260805 22:37:12.863771 20758 tablet_service.cc:1467] Processing CreateTablet for tablet d2b4b33e2fce4c30ad1de2213ebe0e92 (DEFAULT_TABLE table=test-table [id=acb4eadc99154ee9a3ad481b1e5ebc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:12.864137 20839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.858365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37864 (local address 127.19.77.130:41455)
0805 22:37:12.858697 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.858701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.858713 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:37:12.858760 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.858762 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.858779 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.858870 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:12.859216 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.860335 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.862015 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.862792 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.862896 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.862959 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.864005 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.864058 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":80,"threads_started":1}
I20260805 22:37:12.864157 20758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2b4b33e2fce4c30ad1de2213ebe0e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:12.864960 20621 tablet_service.cc:1467] Processing CreateTablet for tablet d2b4b33e2fce4c30ad1de2213ebe0e92 (DEFAULT_TABLE table=test-table [id=acb4eadc99154ee9a3ad481b1e5ebc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:12.865295 20621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2b4b33e2fce4c30ad1de2213ebe0e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:12.867308 20842 tablet_bootstrap.cc:492] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63: Bootstrap starting.
I20260805 22:37:12.868101 20483 tablet_service.cc:1467] Processing CreateTablet for tablet d2b4b33e2fce4c30ad1de2213ebe0e92 (DEFAULT_TABLE table=test-table [id=acb4eadc99154ee9a3ad481b1e5ebc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:12.868459 20483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2b4b33e2fce4c30ad1de2213ebe0e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:12.868470 20842 tablet_bootstrap.cc:654] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:12.868726 20843 tablet_bootstrap.cc:492] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead: Bootstrap starting.
I20260805 22:37:12.869088 20842 log.cc:824] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:12.869566 20843 tablet_bootstrap.cc:654] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:12.870353 20842 tablet_bootstrap.cc:492] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63: No bootstrap required, opened a new log
I20260805 22:37:12.870482 20842 ts_tablet_manager.cc:1397] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:37:12.870597 20843 log.cc:824] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:12.871434 20843 tablet_bootstrap.cc:492] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead: No bootstrap required, opened a new log
I20260805 22:37:12.871520 20843 ts_tablet_manager.cc:1397] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:37:12.874002 20846 tablet_bootstrap.cc:492] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979: Bootstrap starting.
I20260805 22:37:12.874440 20842 raft_consensus.cc:348] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d6d1659cd74e8ab96505194d3f1ead" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41455 } } peers { permanent_uuid: "ada6ac543a474651bf85659c447dca63" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 41199 } } peers { permanent_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39087 } }
I20260805 22:37:12.874747 20842 raft_consensus.cc:374] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:12.874780 20842 raft_consensus.cc:729] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ada6ac543a474651bf85659c447dca63, State: Initialized, Role: FOLLOWER
I20260805 22:37:12.874940 20842 consensus_queue.cc:260] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d6d1659cd74e8ab96505194d3f1ead" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41455 } } peers { permanent_uuid: "ada6ac543a474651bf85659c447dca63" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 41199 } } peers { permanent_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39087 } }
I20260805 22:37:12.875574 20842 ts_tablet_manager.cc:1428] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260805 22:37:12.875604 20824 heartbeater.cc:503] Master 127.19.77.190:42213 was elected leader, sending a full tablet report...
I20260805 22:37:12.876102 20843 raft_consensus.cc:348] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d6d1659cd74e8ab96505194d3f1ead" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41455 } } peers { permanent_uuid: "ada6ac543a474651bf85659c447dca63" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 41199 } } peers { permanent_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39087 } }
I20260805 22:37:12.876596 20846 tablet_bootstrap.cc:654] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:12.876626 20843 raft_consensus.cc:374] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:12.876682 20843 raft_consensus.cc:729] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d6d1659cd74e8ab96505194d3f1ead, State: Initialized, Role: FOLLOWER
I20260805 22:37:12.876987 20843 consensus_queue.cc:260] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d6d1659cd74e8ab96505194d3f1ead" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41455 } } peers { permanent_uuid: "ada6ac543a474651bf85659c447dca63" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 41199 } } peers { permanent_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39087 } }
I20260805 22:37:12.877686 20843 ts_tablet_manager.cc:1428] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260805 22:37:12.877789 20846 log.cc:824] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:12.877805 20688 heartbeater.cc:503] Master 127.19.77.190:42213 was elected leader, sending a full tablet report...
I20260805 22:37:12.879457 20846 tablet_bootstrap.cc:492] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979: No bootstrap required, opened a new log
I20260805 22:37:12.879572 20846 ts_tablet_manager.cc:1397] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260805 22:37:12.882782 20846 raft_consensus.cc:348] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d6d1659cd74e8ab96505194d3f1ead" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41455 } } peers { permanent_uuid: "ada6ac543a474651bf85659c447dca63" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 41199 } } peers { permanent_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39087 } }
I20260805 22:37:12.883078 20846 raft_consensus.cc:374] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:12.883108 20846 raft_consensus.cc:729] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a90bfa6cb28b4f039f991b3e8bddc979, State: Initialized, Role: FOLLOWER
I20260805 22:37:12.883566 20846 consensus_queue.cc:260] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d6d1659cd74e8ab96505194d3f1ead" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41455 } } peers { permanent_uuid: "ada6ac543a474651bf85659c447dca63" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 41199 } } peers { permanent_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39087 } }
I20260805 22:37:12.884302 20846 ts_tablet_manager.cc:1428] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260805 22:37:12.884302 20553 heartbeater.cc:503] Master 127.19.77.190:42213 was elected leader, sending a full tablet report...
W20260805 22:37:12.892416 20689 tablet.cc:2369] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:37:12.948132 20850 raft_consensus.cc:482] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:12.948283 20850 raft_consensus.cc:504] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d6d1659cd74e8ab96505194d3f1ead" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41455 } } peers { permanent_uuid: "ada6ac543a474651bf85659c447dca63" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 41199 } } peers { permanent_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39087 } }
I20260805 22:37:12.948908 20850 leader_election.cc:288] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79d6d1659cd74e8ab96505194d3f1ead (127.19.77.130:41455), ada6ac543a474651bf85659c447dca63 (127.19.77.131:41199)
I20260805 22:37:12.953354 20555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.949143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:41455 (local address 127.19.77.129:47111)
0805 22:37:12.949208 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:12.949222 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:12.949278 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:12.949516 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:12.949517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:12.949519 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:12.949613 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.949615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.950505 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.950506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.951914 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.951917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.952991 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.952992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.953118 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.953122 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:12.953209 (+ 87us) client_negotiation.cc:240] Negotiation successful
0805 22:37:12.953243 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260805 22:37:12.953397 20838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.949339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:55347 (local address 127.19.77.131:41199)
0805 22:37:12.949396 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.949397 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.949616 (+ 219us) server_negotiation.cc:407] Connection header received
0805 22:37:12.949665 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.949667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.949678 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.949741 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:12.949976 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.950619 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.952185 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.952970 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.953039 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.953048 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.953276 (+ 228us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.953322 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:37:12.953397 20839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.949231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:47111 (local address 127.19.77.130:41455)
0805 22:37:12.949285 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.949287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.949360 (+ 73us) server_negotiation.cc:407] Connection header received
0805 22:37:12.949395 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.949396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.949407 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.949472 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:12.949695 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.950404 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.952087 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.952874 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.952985 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.952996 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.953272 (+ 276us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.953322 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:37:12.953405 20851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.949211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:41199 (local address 127.19.77.129:55347)
0805 22:37:12.949528 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:12.949539 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:12.949601 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:12.949755 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:12.949756 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:12.949757 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:12.949894 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.949896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.950716 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.950717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.952091 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:12.952093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.953058 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.953059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:12.953119 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.953122 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:12.953187 (+ 65us) client_negotiation.cc:240] Negotiation successful
0805 22:37:12.953235 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":213,"threads_started":1}
I20260805 22:37:12.954022 20641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2b4b33e2fce4c30ad1de2213ebe0e92" candidate_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d6d1659cd74e8ab96505194d3f1ead" is_pre_election: true
I20260805 22:37:12.954078 20778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2b4b33e2fce4c30ad1de2213ebe0e92" candidate_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ada6ac543a474651bf85659c447dca63" is_pre_election: true
I20260805 22:37:12.954170 20641 raft_consensus.cc:2454] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a90bfa6cb28b4f039f991b3e8bddc979 in term 0.
I20260805 22:37:12.954373 20778 raft_consensus.cc:2454] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a90bfa6cb28b4f039f991b3e8bddc979 in term 0.
I20260805 22:37:12.954746 20436 leader_election.cc:302] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a90bfa6cb28b4f039f991b3e8bddc979, ada6ac543a474651bf85659c447dca63; no voters:
I20260805 22:37:12.954923 20850 raft_consensus.cc:2781] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:12.954988 20850 raft_consensus.cc:482] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:12.955015 20850 raft_consensus.cc:3037] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:12.956247 20850 raft_consensus.cc:504] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d6d1659cd74e8ab96505194d3f1ead" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41455 } } peers { permanent_uuid: "ada6ac543a474651bf85659c447dca63" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 41199 } } peers { permanent_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39087 } }
I20260805 22:37:12.956427 20850 leader_election.cc:288] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [CANDIDATE]: Term 1 election: Requested vote from peers 79d6d1659cd74e8ab96505194d3f1ead (127.19.77.130:41455), ada6ac543a474651bf85659c447dca63 (127.19.77.131:41199)
I20260805 22:37:12.956588 20778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2b4b33e2fce4c30ad1de2213ebe0e92" candidate_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ada6ac543a474651bf85659c447dca63"
I20260805 22:37:12.956635 20641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2b4b33e2fce4c30ad1de2213ebe0e92" candidate_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d6d1659cd74e8ab96505194d3f1ead"
I20260805 22:37:12.956679 20778 raft_consensus.cc:3037] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:12.956712 20641 raft_consensus.cc:3037] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:12.958108 20641 raft_consensus.cc:2454] T d2b4b33e2fce4c30ad1de2213ebe0e92 P 79d6d1659cd74e8ab96505194d3f1ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a90bfa6cb28b4f039f991b3e8bddc979 in term 1.
I20260805 22:37:12.958325 20778 raft_consensus.cc:2454] T d2b4b33e2fce4c30ad1de2213ebe0e92 P ada6ac543a474651bf85659c447dca63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a90bfa6cb28b4f039f991b3e8bddc979 in term 1.
I20260805 22:37:12.958388 20438 leader_election.cc:302] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d6d1659cd74e8ab96505194d3f1ead, a90bfa6cb28b4f039f991b3e8bddc979; no voters:
I20260805 22:37:12.958575 20850 raft_consensus.cc:2781] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:12.958741 20850 raft_consensus.cc:686] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [term 1 LEADER]: Becoming Leader. State: Replica: a90bfa6cb28b4f039f991b3e8bddc979, State: Running, Role: LEADER
I20260805 22:37:12.958855 20850 consensus_queue.cc:237] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d6d1659cd74e8ab96505194d3f1ead" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41455 } } peers { permanent_uuid: "ada6ac543a474651bf85659c447dca63" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 41199 } } peers { permanent_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39087 } }
I20260805 22:37:12.959780 20355 catalog_manager.cc:5495] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979 reported cstate change: term changed from 0 to 1, leader changed from <none> to a90bfa6cb28b4f039f991b3e8bddc979 (127.19.77.129). New cstate: current_term: 1 leader_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d6d1659cd74e8ab96505194d3f1ead" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ada6ac543a474651bf85659c447dca63" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 41199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a90bfa6cb28b4f039f991b3e8bddc979" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39087 } health_report { overall_health: HEALTHY } } }
W20260805 22:37:12.974922 20554 tablet.cc:2369] T d2b4b33e2fce4c30ad1de2213ebe0e92 P a90bfa6cb28b4f039f991b3e8bddc979: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:37:12.986471 20841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:12.976361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36520 (local address 127.19.77.129:39087)
0805 22:37:12.976443 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:12.976445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:12.976653 (+ 208us) server_negotiation.cc:407] Connection header received
0805 22:37:12.976736 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:12.976737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:12.976756 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:12.976838 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:12.977470 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.977963 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.978880 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:12.979081 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:12.979193 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:12.982296 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:12.982319 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:12.982319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:12.982328 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:12.984856 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.985417 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.985421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.985424 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.985503 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:12.985724 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:12.985725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:12.985726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:12.985960 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:12.986187 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:12.986228 (+ 41us) server_negotiation.cc:299] Negotiation successful
0805 22:37:12.986330 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Aug 05 22:37:12 dist-test-slave-chsk krb5kdc[20309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:37:13 dist-test-slave-chsk krb5kdc[20309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969432, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:37:13.019011 20841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:13.008876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36536 (local address 127.19.77.129:39087)
0805 22:37:13.008954 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:13.008957 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:13.008985 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:37:13.009070 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:13.009071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:13.009086 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:13.009149 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:13.010266 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:13.010808 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:13.011762 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:13.011975 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:13.012059 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:13.014971 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:13.014974 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:13.014974 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:13.014983 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:13.016800 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:13.017437 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:13.017439 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:13.017439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:13.017509 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:13.018019 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:13.018022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:13.018023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:13.018206 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:13.018440 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:13.018721 (+ 281us) server_negotiation.cc:299] Negotiation successful
0805 22:37:13.018876 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 05 22:37:13 dist-test-slave-chsk krb5kdc[20309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:37:13 dist-test-slave-chsk krb5kdc[20309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:37:13.051012 20841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:13.041931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36542 (local address 127.19.77.129:39087)
0805 22:37:13.042067 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:13.042070 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:13.042484 (+ 414us) server_negotiation.cc:407] Connection header received
0805 22:37:13.042576 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:13.042578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:13.042595 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:13.042679 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:13.043477 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:13.043989 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:13.044802 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:13.045032 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:13.045099 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:13.047669 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:13.047672 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:13.047672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:13.047680 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:13.049383 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:13.050075 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:13.050076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:13.050076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:13.050149 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:13.050468 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:13.050469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:13.050469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:13.050598 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:13.050800 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:13.050865 (+ 65us) server_negotiation.cc:299] Negotiation successful
0805 22:37:13.050936 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
W20260805 22:37:13.051857 20463 tablet_service.cc:2908] Rejecting scan request for tablet d2b4b33e2fce4c30ad1de2213ebe0e92: Uninitialized: clean time has not yet been initialized
I20260805 22:37:13.053018 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 20420
I20260805 22:37:13.060918 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 20558
I20260805 22:37:13.068197 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 20694
I20260805 22:37:13.074196 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 20322
2026-08-05T22:37:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2164 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:13 dist-test-slave-chsk krb5kdc[20866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:13 dist-test-slave-chsk krb5kdc[20866](info): set up 2 sockets
Aug 05 22:37:13 dist-test-slave-chsk krb5kdc[20866](info): commencing operation
krb5kdc: starting...
W20260805 22:37:14.162513 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:14 dist-test-slave-chsk krb5kdc[20866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:14.308347 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:40175
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:38999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:40175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:14.400413 20879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:14.400663 20879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:14.400688 20879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:14.401858 20879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:14.401896 20879 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 22:37:14.401911 20879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:14.401923 20879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:14.401955 20879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:14.401968 20879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:14.403514 20879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:38999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:40175
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:40175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:14.403738 20879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:14.403932 20879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:14.408921 20886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:14.409003 20884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:14.408928 20888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:14.409823 20879 server_base.cc:1034] running on GCE node
I20260805 22:37:14.410110 20879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:14.410382 20879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:14.411540 20879 hybrid_clock.cc:648] HybridClock initialized: now 1785969434411514 us; error 54 us; skew 500 ppm
Aug 05 22:37:14 dist-test-slave-chsk krb5kdc[20866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:14.414136 20879 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:14.414713 20879 webserver.cc:460] Webserver started at http://127.19.77.190:40307/ using document root <none> and password file <none>
I20260805 22:37:14.414932 20879 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:14.414978 20879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:14.415078 20879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:14.416251 20879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "e480d33131014a8ab111962afcab66c6"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "2f791cb3303a06c98cff7b9fd900e36f"
server_key_iv: "04d8307cab4c3421d17d907f112a2c9b"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.416584 20879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "e480d33131014a8ab111962afcab66c6"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "2f791cb3303a06c98cff7b9fd900e36f"
server_key_iv: "04d8307cab4c3421d17d907f112a2c9b"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.417980 20879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:14.418841 20895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:14.419091 20879 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:14.419255 20879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "e480d33131014a8ab111962afcab66c6"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "2f791cb3303a06c98cff7b9fd900e36f"
server_key_iv: "04d8307cab4c3421d17d907f112a2c9b"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.419327 20879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:14.440200 20879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:14.442510 20879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:14.442646 20879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:14.448247 20879 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:40175
I20260805 22:37:14.448364 20958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:40175 every 8 connection(s)
I20260805 22:37:14.448743 20879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:14.449448 20959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:14.452031 20959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6: Bootstrap starting.
I20260805 22:37:14.452711 20959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:14.453024 20959 log.cc:824] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:14.453867 20959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6: No bootstrap required, opened a new log
I20260805 22:37:14.455305 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 20879
I20260805 22:37:14.455425 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:14.455595 19766 external_mini_cluster.cc:1428] Setting key 055336991a102ce3a6d551b5f32ac945
I20260805 22:37:14.456928 20959 raft_consensus.cc:348] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e480d33131014a8ab111962afcab66c6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40175 } }
I20260805 22:37:14.457113 20959 raft_consensus.cc:374] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:14.457165 20959 raft_consensus.cc:729] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e480d33131014a8ab111962afcab66c6, State: Initialized, Role: FOLLOWER
I20260805 22:37:14.457331 20959 consensus_queue.cc:260] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e480d33131014a8ab111962afcab66c6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40175 } }
I20260805 22:37:14.457423 20959 raft_consensus.cc:388] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:14.457473 20959 raft_consensus.cc:482] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:14.457549 20959 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:14.458223 20959 raft_consensus.cc:504] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e480d33131014a8ab111962afcab66c6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40175 } }
I20260805 22:37:14.458349 20959 leader_election.cc:302] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e480d33131014a8ab111962afcab66c6; no voters:
I20260805 22:37:14.458539 20959 leader_election.cc:288] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:14.458606 20964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:14.458770 20964 raft_consensus.cc:686] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [term 1 LEADER]: Becoming Leader. State: Replica: e480d33131014a8ab111962afcab66c6, State: Running, Role: LEADER
I20260805 22:37:14.458840 20959 sys_catalog.cc:564] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:14.458863 20964 consensus_queue.cc:237] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e480d33131014a8ab111962afcab66c6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40175 } }
I20260805 22:37:14.459239 20965 sys_catalog.cc:455] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e480d33131014a8ab111962afcab66c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e480d33131014a8ab111962afcab66c6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40175 } } }
I20260805 22:37:14.459326 20965 sys_catalog.cc:458] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:14.459227 20964 sys_catalog.cc:455] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e480d33131014a8ab111962afcab66c6. Latest consensus state: current_term: 1 leader_uuid: "e480d33131014a8ab111962afcab66c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e480d33131014a8ab111962afcab66c6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40175 } } }
I20260805 22:37:14.459527 20964 sys_catalog.cc:458] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:14.459658 20970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:14.460469 20970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 05 22:37:14 dist-test-slave-chsk krb5kdc[20866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:14.468386 20970 catalog_manager.cc:1347] Generated new cluster ID: 4bff7395b0484393a8bc29da3835e2cb
I20260805 22:37:14.468506 20970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:14.468694 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:14.456236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43792 (local address 127.19.77.190:40175)
0805 22:37:14.456483 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:14.456492 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:14.456522 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:37:14.456935 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:14.456944 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:14.457005 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:14.457210 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:14.458019 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.459355 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.460861 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.461481 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.461613 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:14.464890 (+ 3277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:14.464895 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:14.464896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:14.464916 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:14.466763 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:14.467210 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:14.467214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:14.467214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:14.467342 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:14.467565 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:14.467567 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:14.467567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:14.467924 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:14.468100 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:14.468222 (+ 122us) server_negotiation.cc:299] Negotiation successful
0805 22:37:14.468391 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":122,"threads_started":1}
I20260805 22:37:14.488323 20970 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:14.488927 20970 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:14.495378 20970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6: Generated new TSK 0
I20260805 22:37:14.495628 20970 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:37:14.526710 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40175
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:38999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:14.621142 20987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:14.621393 20987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:14.621423 20987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:14.622926 20987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:14.622980 20987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:14.623004 20987 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:37:14.623025 20987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:14.625813 20987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:38999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.77.190:40175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:14.626096 20987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:14.626310 20987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:37:14.631835 20987 server_base.cc:1034] running on GCE node
W20260805 22:37:14.631817 20992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:14.631812 20993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:14.631817 20995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:14.632539 20987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:14.632882 20987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:14.634140 20987 hybrid_clock.cc:648] HybridClock initialized: now 1785969434634090 us; error 55 us; skew 500 ppm
Aug 05 22:37:14 dist-test-slave-chsk krb5kdc[20866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:14.637434 20987 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:37:14.637948 20987 webserver.cc:460] Webserver started at http://127.19.77.129:44955/ using document root <none> and password file <none>
I20260805 22:37:14.638219 20987 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:14.638295 20987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:14.638455 20987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:14.639703 20987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "59695b623295459e94d1c0beb0818c3b"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "48c34e0db44b5f02892b550a1c2c3230"
server_key_iv: "383c9b86e3c9cf6696b547ddaa993501"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.640126 20987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "59695b623295459e94d1c0beb0818c3b"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "48c34e0db44b5f02892b550a1c2c3230"
server_key_iv: "383c9b86e3c9cf6696b547ddaa993501"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.642150 20987 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260805 22:37:14.643092 21003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:14.643345 20987 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:14.643455 20987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "59695b623295459e94d1c0beb0818c3b"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "48c34e0db44b5f02892b550a1c2c3230"
server_key_iv: "383c9b86e3c9cf6696b547ddaa993501"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.643555 20987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:14.658300 20987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:14.661695 20987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:14.661909 20987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:14.662556 20987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:14.662622 20987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:14.662660 20987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:14.662688 20987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:37:14 dist-test-slave-chsk krb5kdc[20866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:14.670526 20987 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:42157
I20260805 22:37:14.670641 21121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:42157 every 8 connection(s)
I20260805 22:37:14.670969 20987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:14.673195 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 20987
I20260805 22:37:14.673310 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:14.673501 19766 external_mini_cluster.cc:1428] Setting key 62e964279e617528a3017f203606181a
I20260805 22:37:14.674152 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:14.663411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:45083 (local address 127.19.77.190:40175)
0805 22:37:14.663489 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:14.663491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:14.663719 (+ 228us) server_negotiation.cc:407] Connection header received
0805 22:37:14.664409 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:14.664410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:14.664431 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:14.664517 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:14.665453 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.666321 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.667591 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.667829 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.667923 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:14.670345 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:14.670346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:14.670347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:14.670355 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:14.672144 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:14.672595 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:14.672603 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:14.672603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:14.672668 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:14.672940 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:14.672941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:14.672941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:14.673145 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:14.673233 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:14.673937 (+ 704us) server_negotiation.cc:299] Negotiation successful
0805 22:37:14.674031 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260805 22:37:14.674500 21012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:14.663399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40175 (local address 127.19.77.129:45083)
0805 22:37:14.663597 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:14.663641 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:14.664249 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:14.664601 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:14.664607 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:14.665004 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:14.665321 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:14.665330 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.666451 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.666452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:14.667491 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:14.667495 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.667961 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.667962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:14.668098 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:14.668732 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:14.668741 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:14.670222 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:14.672247 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:14.672255 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:14.672257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:14.672496 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:14.672746 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:14.672747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:14.672747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:14.672862 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:14.673375 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:14.673398 (+ 23us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:14.673732 (+ 334us) client_negotiation.cc:769] Sending connection context
0805 22:37:14.673895 (+ 163us) client_negotiation.cc:240] Negotiation successful
0805 22:37:14.674124 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":127,"threads_started":1}
I20260805 22:37:14.675282 21122 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40175
I20260805 22:37:14.675446 21122 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:14.675709 21122 heartbeater.cc:511] Master 127.19.77.190:40175 requested a full tablet report, sending...
I20260805 22:37:14.676792 20912 ts_manager.cc:194] Registered new tserver with Master: 59695b623295459e94d1c0beb0818c3b (127.19.77.129:42157)
I20260805 22:37:14.677537 20912 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:45083
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:37:14.687489 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:14.676935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:40191 (local address 127.19.77.190:40175)
0805 22:37:14.676989 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:14.676992 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:14.679453 (+ 2461us) server_negotiation.cc:407] Connection header received
0805 22:37:14.679489 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:14.679490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:14.679504 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:14.679582 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:14.680037 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.681061 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.681900 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.682251 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.682339 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:14.683504 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:14.683506 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:14.683506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:14.683577 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:14.685591 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:14.686037 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:14.686039 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:14.686039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:14.686127 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:14.686674 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:14.686677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:14.686677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:14.686874 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:14.686967 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:14.687316 (+ 349us) server_negotiation.cc:299] Negotiation successful
0805 22:37:14.687414 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:37:14.687615 21129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:14.676854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40175 (local address 127.19.77.129:40191)
0805 22:37:14.679359 (+ 2505us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:14.679371 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:14.679440 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:14.679591 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:14.679592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:14.679804 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:14.679880 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:14.679882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.681239 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.681240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:14.681797 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:14.681799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.682344 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.682344 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:14.682407 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:14.682970 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:14.682976 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:14.683411 (+ 435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:14.685688 (+ 2277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:14.685690 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:14.685690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:14.685881 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:14.686223 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:14.686224 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:14.686225 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:14.686456 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:14.687008 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:14.687009 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:14.687108 (+ 99us) client_negotiation.cc:769] Sending connection context
0805 22:37:14.687263 (+ 155us) client_negotiation.cc:240] Negotiation successful
0805 22:37:14.687422 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2473,"thread_start_us":126,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:37:14.707762 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40175
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:38999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:14.802356 21131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:14.802668 21131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:14.802704 21131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:14.804106 21131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:14.804154 21131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:14.804177 21131 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:37:14.804196 21131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:14.805788 21131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:38999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.77.190:40175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:14.806082 21131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:14.806341 21131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:14.812003 21137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:14.812031 21139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:14.812139 21131 server_base.cc:1034] running on GCE node
W20260805 22:37:14.812350 21136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:14.812644 21131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:14.812958 21131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:14.814149 21131 hybrid_clock.cc:648] HybridClock initialized: now 1785969434814126 us; error 45 us; skew 500 ppm
Aug 05 22:37:14 dist-test-slave-chsk krb5kdc[20866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:14.817909 21131 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:37:14.818501 21131 webserver.cc:460] Webserver started at http://127.19.77.130:33301/ using document root <none> and password file <none>
I20260805 22:37:14.818782 21131 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:14.818859 21131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:14.819026 21131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:14.820237 21131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "6c002be1de3743d0a7135b2f93ea3b81"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "73ec1a610055ecebb15bb15b1403275a"
server_key_iv: "e16fa03b8855d26a1adecaacdf306626"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.820637 21131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "6c002be1de3743d0a7135b2f93ea3b81"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "73ec1a610055ecebb15bb15b1403275a"
server_key_iv: "e16fa03b8855d26a1adecaacdf306626"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.822300 21131 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:14.823518 21146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:14.823710 21131 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:14.823814 21131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "6c002be1de3743d0a7135b2f93ea3b81"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "73ec1a610055ecebb15bb15b1403275a"
server_key_iv: "e16fa03b8855d26a1adecaacdf306626"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.823920 21131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:14.832595 21131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:14.835317 21131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:14.835520 21131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:14.836108 21131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:14.836190 21131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:14.836243 21131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:14.836272 21131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:14.843748 21131 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:45061
I20260805 22:37:14.843803 21265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:45061 every 8 connection(s)
Aug 05 22:37:14 dist-test-slave-chsk krb5kdc[20866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:14.844194 21131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:14.844592 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 21131
I20260805 22:37:14.844708 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:14.844915 19766 external_mini_cluster.cc:1428] Setting key 59c6304b2a7fc6c19b719b713e290d70
I20260805 22:37:14.848649 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:14.836740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:44719 (local address 127.19.77.190:40175)
0805 22:37:14.836823 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:14.836827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:14.836989 (+ 162us) server_negotiation.cc:407] Connection header received
0805 22:37:14.837507 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:14.837509 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:14.837523 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:14.837613 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:14.838582 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.839481 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.841177 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.841510 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.841605 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:14.844742 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:14.844744 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:14.844744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:14.844755 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:14.846496 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:14.847061 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:14.847063 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:14.847063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:14.847133 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:14.847602 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:14.847605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:14.847606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:14.847996 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:14.848091 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:14.848414 (+ 323us) server_negotiation.cc:299] Negotiation successful
0805 22:37:14.848523 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260805 22:37:14.848747 21155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:14.836646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40175 (local address 127.19.77.130:44719)
0805 22:37:14.836843 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:14.836886 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:14.837396 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:14.837713 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:14.837716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:14.838120 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:14.838438 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:14.838445 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.839620 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.839621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:14.841055 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:14.841059 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.841607 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.841608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:14.841715 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:14.842373 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:14.842386 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:14.844599 (+ 2213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:14.846603 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:14.846612 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:14.846615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:14.846962 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:14.847269 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:14.847270 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:14.847270 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:14.847428 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:14.848102 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:14.848109 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:14.848256 (+ 147us) client_negotiation.cc:769] Sending connection context
0805 22:37:14.848366 (+ 110us) client_negotiation.cc:240] Negotiation successful
0805 22:37:14.848519 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":85,"threads_started":1}
I20260805 22:37:14.849442 21266 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40175
I20260805 22:37:14.849550 21266 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:14.849779 21266 heartbeater.cc:511] Master 127.19.77.190:40175 requested a full tablet report, sending...
I20260805 22:37:14.850179 20912 ts_manager.cc:194] Registered new tserver with Master: 6c002be1de3743d0a7135b2f93ea3b81 (127.19.77.130:45061)
I20260805 22:37:14.850596 20912 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:44719
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
I20260805 22:37:14.859921 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:14.851590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:54791 (local address 127.19.77.190:40175)
0805 22:37:14.851642 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:14.851644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:14.851827 (+ 183us) server_negotiation.cc:407] Connection header received
0805 22:37:14.851858 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:14.851859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:14.851873 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:14.851935 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:14.852267 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.853094 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.853897 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.854239 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.854326 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:14.855641 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:14.855643 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:14.855643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:14.855652 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:14.857655 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:14.858415 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:14.858417 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:14.858417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:14.858501 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:14.859098 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:14.859100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:14.859100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:14.859384 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:14.859539 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:14.859723 (+ 184us) server_negotiation.cc:299] Negotiation successful
0805 22:37:14.859817 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:37:14.859943 21273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:14.851552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40175 (local address 127.19.77.130:54791)
0805 22:37:14.851703 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:14.851714 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:14.851778 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:14.851945 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:14.851945 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:14.852125 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:14.852188 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:14.852190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.853286 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.853287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:14.853797 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:14.853799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:14.854346 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:14.854347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:14.854419 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:14.855062 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:14.855067 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:14.855529 (+ 462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:14.857895 (+ 2366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:14.857897 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:14.857897 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:14.858190 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:14.858719 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:14.858721 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:14.858721 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:14.858987 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:14.859530 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:14.859531 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:14.859600 (+ 69us) client_negotiation.cc:769] Sending connection context
0805 22:37:14.859696 (+ 96us) client_negotiation.cc:240] Negotiation successful
0805 22:37:14.859818 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:37:14.876477 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40175
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:38999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:14.969226 21275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:14.969471 21275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:14.969498 21275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:14.970728 21275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:14.970784 21275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:14.970831 21275 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:37:14.970851 21275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:14.972493 21275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:38999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.77.190:40175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:14.972740 21275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:14.972939 21275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:14.978560 21283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:14.978554 21280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:14.978767 21281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:14.979113 21275 server_base.cc:1034] running on GCE node
I20260805 22:37:14.979480 21275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:14.979789 21275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:14.980991 21275 hybrid_clock.cc:648] HybridClock initialized: now 1785969434980959 us; error 46 us; skew 500 ppm
Aug 05 22:37:14 dist-test-slave-chsk krb5kdc[20866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:14.988634 21275 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:37:14.989315 21275 webserver.cc:460] Webserver started at http://127.19.77.131:44673/ using document root <none> and password file <none>
I20260805 22:37:14.989588 21275 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:14.989666 21275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:14.989828 21275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:14.991091 21275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "1a60e1096d6e472abbd2a30a2c8adf0e"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "099872e8602c0a7c7e869c5076e1a3c7"
server_key_iv: "85c2c2ff1839f07bab9be24a1cc36d7a"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.991575 21275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "1a60e1096d6e472abbd2a30a2c8adf0e"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "099872e8602c0a7c7e869c5076e1a3c7"
server_key_iv: "85c2c2ff1839f07bab9be24a1cc36d7a"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.993281 21275 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:37:14.994321 21290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:14.994519 21275 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:14.994637 21275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "1a60e1096d6e472abbd2a30a2c8adf0e"
format_stamp: "Formatted at 2026-08-05 22:37:14 on dist-test-slave-chsk"
server_key: "099872e8602c0a7c7e869c5076e1a3c7"
server_key_iv: "85c2c2ff1839f07bab9be24a1cc36d7a"
server_key_version: "encryptionkey@0"
I20260805 22:37:14.994720 21275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:15.016762 21275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:15.019361 21275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:15.019559 21275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:15.020252 21275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:15.020315 21275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:15.020354 21275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:15.020381 21275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:37:15 dist-test-slave-chsk krb5kdc[20866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:15.028998 21275 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:39457
I20260805 22:37:15.029093 21408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:39457 every 8 connection(s)
I20260805 22:37:15.029464 21275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:37:15.033036 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.021455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:34235 (local address 127.19.77.190:40175)
0805 22:37:15.021524 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.021526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.021738 (+ 212us) server_negotiation.cc:407] Connection header received
0805 22:37:15.022651 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.022652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.022689 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.022759 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:15.023680 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.024399 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.025617 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.026137 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.026242 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.029177 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:15.029179 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:15.029179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:15.029190 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:15.030876 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.031795 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.031796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.031796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.031870 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.032317 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.032318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.032319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.032450 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:15.032512 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.032875 (+ 363us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.032965 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:37:15.033268 21300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.021404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40175 (local address 127.19.77.131:34235)
0805 22:37:15.021600 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.021644 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.022515 (+ 871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.022866 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.022871 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.023346 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:15.023570 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.023576 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.024516 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.024517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.025398 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.025400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.026266 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.026268 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.026482 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.027192 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:15.027203 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:15.029008 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:15.031060 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:15.031078 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:15.031081 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:15.031648 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:15.031998 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:15.032000 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:15.032000 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:15.032198 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:15.032537 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:15.032545 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:15.032693 (+ 148us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.032794 (+ 101us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.032978 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":97,"threads_started":1}
I20260805 22:37:15.033877 21409 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40175
I20260805 22:37:15.033974 21409 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:15.034235 21409 heartbeater.cc:511] Master 127.19.77.190:40175 requested a full tablet report, sending...
I20260805 22:37:15.034374 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 21275
I20260805 22:37:15.034466 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:15.034653 19766 external_mini_cluster.cc:1428] Setting key 23b258c24a06205654acb67a5ccb89ed
I20260805 22:37:15.034670 20911 ts_manager.cc:194] Registered new tserver with Master: 1a60e1096d6e472abbd2a30a2c8adf0e (127.19.77.131:39457)
I20260805 22:37:15.035255 20911 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:34235
I20260805 22:37:15.035580 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:37:15.045892 21415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.035112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40175 (local address 127.19.77.131:51225)
0805 22:37:15.035539 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.037712 (+ 2173us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.037789 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.037944 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.037944 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.038144 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:15.038223 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.038225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.039198 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.039200 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.040118 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.040122 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.040507 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.040508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.040606 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.041175 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:15.041181 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:15.041655 (+ 474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:15.044484 (+ 2829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:15.044485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:15.044486 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:15.044826 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:15.045063 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:15.045064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:15.045064 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:15.045160 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:15.045458 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:15.045460 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:15.045565 (+ 105us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.045650 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.045777 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":121,"threads_started":1}
I20260805 22:37:15.045879 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.035098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:51225 (local address 127.19.77.190:40175)
0805 22:37:15.035228 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.035230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.037807 (+ 2577us) server_negotiation.cc:407] Connection header received
0805 22:37:15.037843 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.037845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.037859 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.037941 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:15.038293 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.039047 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.040238 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.040431 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.040502 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.041905 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:15.041908 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:15.041909 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:15.041923 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:15.044357 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.044926 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.044928 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.044928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.044989 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.045238 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.045239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.045239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.045367 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:15.045464 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.045678 (+ 214us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.045774 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
Aug 05 22:37:15 dist-test-slave-chsk krb5kdc[20866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969435, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:37:15 dist-test-slave-chsk krb5kdc[20866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969435, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:15.064329 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.056315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43794 (local address 127.19.77.190:40175)
0805 22:37:15.056385 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.056386 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.056437 (+ 51us) server_negotiation.cc:407] Connection header received
0805 22:37:15.056536 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.056537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.056545 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.056615 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:15.057250 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.057783 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.058541 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.058737 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.058798 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.061553 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:15.061555 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:15.061555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:15.061562 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:15.063090 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.063481 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.063482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.063482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.063533 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.063779 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.063780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.063780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.063914 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:15.064008 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.064187 (+ 179us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.064259 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:37:15.066015 20912 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43794:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:15.067778 20912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:15.074911 21428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.070617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42157 (local address 127.0.0.1:59938)
0805 22:37:15.071040 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.071048 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.071092 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.071636 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.071637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.071639 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:15.071671 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.071672 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.072874 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.072875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.073751 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.073754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.074536 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.074537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.074632 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.074648 (+ 16us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.074744 (+ 96us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.074810 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":99,"threads_started":1}
I20260805 22:37:15.074918 21433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.070733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59938 (local address 127.19.77.129:42157)
0805 22:37:15.070922 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.070927 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.071090 (+ 163us) server_negotiation.cc:407] Connection header received
0805 22:37:15.071475 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.071478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.071494 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.071638 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:15.071728 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.072813 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.073858 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.074442 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.074535 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.074601 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.074774 (+ 173us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.074815 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":120,"threads_started":1}
I20260805 22:37:15.075374 21430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.070455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56740 (local address 127.19.77.130:45061)
0805 22:37:15.071274 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.071278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.071287 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:15.071322 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.071324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.071341 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.071425 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:15.071575 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.072733 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.074027 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.074833 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.074899 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.074952 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.075221 (+ 269us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.075265 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":783,"thread_start_us":79,"threads_started":1}
I20260805 22:37:15.075394 21429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.070350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:39457 (local address 127.0.0.1:43046)
0805 22:37:15.070562 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.070607 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.070933 (+ 326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.071257 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.071260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.071263 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:15.071356 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.071359 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.072366 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.072367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.073720 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.073723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.074804 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.074805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.074874 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.074879 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.074927 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.075181 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":70,"threads_started":1}
I20260805 22:37:15.075611 21432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.070352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:45061 (local address 127.0.0.1:56740)
0805 22:37:15.070759 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.070771 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.070840 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.071438 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.071439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.071442 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:15.071490 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.071495 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.072820 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.072822 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.073941 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.073944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.074984 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.074985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.075067 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.075072 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.075129 (+ 57us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.075539 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":43,"thread_start_us":129,"threads_started":1}
I20260805 22:37:15.075786 21431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.070453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43046 (local address 127.19.77.131:39457)
0805 22:37:15.070819 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.070825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.070838 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:37:15.071041 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.071043 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.071061 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.071178 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:15.071438 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.072273 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.073823 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.074585 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.074661 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.074716 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.075619 (+ 903us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.075670 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":100,"threads_started":1}
I20260805 22:37:15.075858 21054 tablet_service.cc:1467] Processing CreateTablet for tablet cc3d234ce65643febb960c9d299a11ce (DEFAULT_TABLE table=test-table [id=da9de18cdda24ff082a29e4c1e75622b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:15.076295 21054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc3d234ce65643febb960c9d299a11ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:15.076241 21198 tablet_service.cc:1467] Processing CreateTablet for tablet cc3d234ce65643febb960c9d299a11ce (DEFAULT_TABLE table=test-table [id=da9de18cdda24ff082a29e4c1e75622b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:15.076550 21198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc3d234ce65643febb960c9d299a11ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:15.079941 21343 tablet_service.cc:1467] Processing CreateTablet for tablet cc3d234ce65643febb960c9d299a11ce (DEFAULT_TABLE table=test-table [id=da9de18cdda24ff082a29e4c1e75622b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:15.080163 21434 tablet_bootstrap.cc:492] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: Bootstrap starting.
I20260805 22:37:15.080180 21435 tablet_bootstrap.cc:492] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: Bootstrap starting.
I20260805 22:37:15.080341 21343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc3d234ce65643febb960c9d299a11ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:15.080808 21435 tablet_bootstrap.cc:654] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:15.081022 21434 tablet_bootstrap.cc:654] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:15.081590 21435 log.cc:824] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:15.081663 21434 log.cc:824] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:15.082549 21434 tablet_bootstrap.cc:492] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: No bootstrap required, opened a new log
I20260805 22:37:15.082649 21434 ts_tablet_manager.cc:1397] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:37:15.084826 21438 tablet_bootstrap.cc:492] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: Bootstrap starting.
I20260805 22:37:15.084960 21434 raft_consensus.cc:348] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } }
I20260805 22:37:15.085201 21434 raft_consensus.cc:374] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:15.085245 21434 raft_consensus.cc:729] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59695b623295459e94d1c0beb0818c3b, State: Initialized, Role: FOLLOWER
I20260805 22:37:15.085389 21434 consensus_queue.cc:260] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } }
I20260805 22:37:15.085703 21434 ts_tablet_manager.cc:1428] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:37:15.085880 21122 heartbeater.cc:503] Master 127.19.77.190:40175 was elected leader, sending a full tablet report...
I20260805 22:37:15.086366 21435 tablet_bootstrap.cc:492] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: No bootstrap required, opened a new log
I20260805 22:37:15.086436 21435 ts_tablet_manager.cc:1397] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260805 22:37:15.086596 21438 tablet_bootstrap.cc:654] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:15.087280 21438 log.cc:824] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:15.088249 21438 tablet_bootstrap.cc:492] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: No bootstrap required, opened a new log
I20260805 22:37:15.088352 21438 ts_tablet_manager.cc:1397] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260805 22:37:15.088344 21435 raft_consensus.cc:348] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } }
I20260805 22:37:15.088486 21435 raft_consensus.cc:374] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:15.088514 21435 raft_consensus.cc:729] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c002be1de3743d0a7135b2f93ea3b81, State: Initialized, Role: FOLLOWER
I20260805 22:37:15.088610 21435 consensus_queue.cc:260] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } }
I20260805 22:37:15.088903 21435 ts_tablet_manager.cc:1428] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:37:15.088959 21266 heartbeater.cc:503] Master 127.19.77.190:40175 was elected leader, sending a full tablet report...
I20260805 22:37:15.090983 21438 raft_consensus.cc:348] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } }
I20260805 22:37:15.091368 21438 raft_consensus.cc:374] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:15.091430 21438 raft_consensus.cc:729] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a60e1096d6e472abbd2a30a2c8adf0e, State: Initialized, Role: FOLLOWER
I20260805 22:37:15.091595 21438 consensus_queue.cc:260] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } }
I20260805 22:37:15.092093 21438 ts_tablet_manager.cc:1428] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260805 22:37:15.092168 21409 heartbeater.cc:503] Master 127.19.77.190:40175 was elected leader, sending a full tablet report...
W20260805 22:37:15.094990 21267 tablet.cc:2369] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:37:15.172313 21123 tablet.cc:2369] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:37:15.280234 21410 tablet.cc:2369] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:37:15.480619 21439 raft_consensus.cc:482] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:15.480770 21439 raft_consensus.cc:504] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } }
I20260805 22:37:15.481220 21439 leader_election.cc:288] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a60e1096d6e472abbd2a30a2c8adf0e (127.19.77.131:39457), 6c002be1de3743d0a7135b2f93ea3b81 (127.19.77.130:45061)
I20260805 22:37:15.484730 21431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.481563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:59087 (local address 127.19.77.131:39457)
0805 22:37:15.481614 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.481617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.481969 (+ 352us) server_negotiation.cc:407] Connection header received
0805 22:37:15.481999 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.482000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.482011 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.482070 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:15.482480 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.483025 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.483978 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.484340 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.484400 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.484408 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.484590 (+ 182us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.484638 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:37:15.484750 21430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.481512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:38929 (local address 127.19.77.130:45061)
0805 22:37:15.481565 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.481567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.481715 (+ 148us) server_negotiation.cc:407] Connection header received
0805 22:37:15.481773 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.481774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.481786 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.481843 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:15.482294 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.482844 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.484013 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.484357 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.484451 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.484460 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.484640 (+ 180us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.484687 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:37:15.484757 21445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.481469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:39457 (local address 127.19.77.129:59087)
0805 22:37:15.481722 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.481733 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.481795 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.482304 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.482305 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.482308 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:15.482383 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.482385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.483120 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.483121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.483880 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.483882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.484430 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.484432 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.484516 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.484520 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.484564 (+ 44us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.484623 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":2,"thread_start_us":75,"threads_started":1}
I20260805 22:37:15.484764 21443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.481449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:45061 (local address 127.19.77.129:38929)
0805 22:37:15.481617 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.481628 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.481709 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.481981 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.481983 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.481985 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:15.482082 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.482085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.482934 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.482935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.483881 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.483885 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.484479 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.484480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.484535 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.484538 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.484616 (+ 78us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.484655 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":1,"thread_start_us":76,"threads_started":1}
I20260805 22:37:15.485152 21363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc3d234ce65643febb960c9d299a11ce" candidate_uuid: "59695b623295459e94d1c0beb0818c3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" is_pre_election: true
I20260805 22:37:15.485347 21363 raft_consensus.cc:2454] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59695b623295459e94d1c0beb0818c3b in term 0.
I20260805 22:37:15.485376 21218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc3d234ce65643febb960c9d299a11ce" candidate_uuid: "59695b623295459e94d1c0beb0818c3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c002be1de3743d0a7135b2f93ea3b81" is_pre_election: true
I20260805 22:37:15.485541 21218 raft_consensus.cc:2454] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59695b623295459e94d1c0beb0818c3b in term 0.
I20260805 22:37:15.485641 21006 leader_election.cc:302] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a60e1096d6e472abbd2a30a2c8adf0e, 59695b623295459e94d1c0beb0818c3b; no voters:
I20260805 22:37:15.485800 21439 raft_consensus.cc:2781] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:15.485862 21439 raft_consensus.cc:482] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:15.485919 21439 raft_consensus.cc:3037] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:15.486682 21439 raft_consensus.cc:504] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } }
I20260805 22:37:15.486840 21439 leader_election.cc:288] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [CANDIDATE]: Term 1 election: Requested vote from peers 1a60e1096d6e472abbd2a30a2c8adf0e (127.19.77.131:39457), 6c002be1de3743d0a7135b2f93ea3b81 (127.19.77.130:45061)
I20260805 22:37:15.487008 21218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc3d234ce65643febb960c9d299a11ce" candidate_uuid: "59695b623295459e94d1c0beb0818c3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c002be1de3743d0a7135b2f93ea3b81"
I20260805 22:37:15.487020 21363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc3d234ce65643febb960c9d299a11ce" candidate_uuid: "59695b623295459e94d1c0beb0818c3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e"
I20260805 22:37:15.487092 21363 raft_consensus.cc:3037] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:15.487092 21218 raft_consensus.cc:3037] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:15.488022 21218 raft_consensus.cc:2454] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59695b623295459e94d1c0beb0818c3b in term 1.
I20260805 22:37:15.488034 21363 raft_consensus.cc:2454] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59695b623295459e94d1c0beb0818c3b in term 1.
I20260805 22:37:15.488234 21007 leader_election.cc:302] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59695b623295459e94d1c0beb0818c3b, 6c002be1de3743d0a7135b2f93ea3b81; no voters:
I20260805 22:37:15.488343 21439 raft_consensus.cc:2781] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:15.488471 21439 raft_consensus.cc:686] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 1 LEADER]: Becoming Leader. State: Replica: 59695b623295459e94d1c0beb0818c3b, State: Running, Role: LEADER
I20260805 22:37:15.488592 21439 consensus_queue.cc:237] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } }
I20260805 22:37:15.489481 20912 catalog_manager.cc:5495] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 59695b623295459e94d1c0beb0818c3b (127.19.77.129). New cstate: current_term: 1 leader_uuid: "59695b623295459e94d1c0beb0818c3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } health_report { overall_health: UNKNOWN } } }
I20260805 22:37:15.522027 21433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.518969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59952 (local address 127.19.77.129:42157)
0805 22:37:15.519045 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.519047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.519057 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:15.519097 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.519098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.519132 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.519207 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:15.519350 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.519827 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.520966 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.521183 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.521252 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.521560 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:15.521680 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:15.521748 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.521863 (+ 115us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.521886 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:37:15.524537 21363 raft_consensus.cc:1261] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 FOLLOWER]: Refusing update from remote peer 59695b623295459e94d1c0beb0818c3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:15.524537 21218 raft_consensus.cc:1261] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81 [term 1 FOLLOWER]: Refusing update from remote peer 59695b623295459e94d1c0beb0818c3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:15.524915 21439 consensus_queue.cc:1035] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:15.525099 21446 consensus_queue.cc:1035] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:15.527638 21449 mvcc.cc:205] Tried to move back new op lower bound from 7315330807905124352 to 7315330807762046976. Current Snapshot: MvccSnapshot[applied={T|T < 7315330807905124352}]
I20260805 22:37:15.528096 21451 mvcc.cc:205] Tried to move back new op lower bound from 7315330807905124352 to 7315330807762046976. Current Snapshot: MvccSnapshot[applied={T|T < 7315330807905124352}]
I20260805 22:37:15.529291 21450 mvcc.cc:205] Tried to move back new op lower bound from 7315330807905124352 to 7315330807762046976. Current Snapshot: MvccSnapshot[applied={T|T < 7315330807905124352}]
I20260805 22:37:15.532543 20911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:15.532675 20911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:15.533896 20911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6: Sending DeleteTablet for 3 replicas of tablet cc3d234ce65643febb960c9d299a11ce
I20260805 22:37:15.534639 21343 tablet_service.cc:1514] Processing DeleteTablet for tablet cc3d234ce65643febb960c9d299a11ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:15 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:43046
I20260805 22:37:15.534633 21198 tablet_service.cc:1514] Processing DeleteTablet for tablet cc3d234ce65643febb960c9d299a11ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:15 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:56740
I20260805 22:37:15.534963 21054 tablet_service.cc:1514] Processing DeleteTablet for tablet cc3d234ce65643febb960c9d299a11ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:15 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:59938
I20260805 22:37:15.534912 20911 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43794:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:15.535101 20911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:15.535266 21461 tablet_replica.cc:330] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: stopping tablet replica
I20260805 22:37:15.535385 21461 raft_consensus.cc:2229] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:15.535488 21461 raft_consensus.cc:2258] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:15.535770 21460 tablet_replica.cc:330] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: stopping tablet replica
I20260805 22:37:15.535899 21460 raft_consensus.cc:2229] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:15.536027 21460 raft_consensus.cc:2258] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:15.536309 21459 tablet_replica.cc:330] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: stopping tablet replica
I20260805 22:37:15.536439 21459 raft_consensus.cc:2229] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:15.536463 21461 ts_tablet_manager.cc:1905] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:15.536551 21459 raft_consensus.cc:2258] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:15.536950 21460 ts_tablet_manager.cc:1905] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:15.537674 21198 tablet_service.cc:1467] Processing CreateTablet for tablet 54df5e56545643f38c1efcdb78d0da0a (DEFAULT_TABLE table=test-table [id=57dc602a1dfc44789588e4fb4a3672ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:15.537837 21198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54df5e56545643f38c1efcdb78d0da0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:15.538959 21461 ts_tablet_manager.cc:1918] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:15.539125 21054 tablet_service.cc:1467] Processing CreateTablet for tablet 54df5e56545643f38c1efcdb78d0da0a (DEFAULT_TABLE table=test-table [id=57dc602a1dfc44789588e4fb4a3672ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:15.539256 21054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54df5e56545643f38c1efcdb78d0da0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:15.539269 21459 ts_tablet_manager.cc:1905] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:15.539183 21461 log.cc:1196] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/cc3d234ce65643febb960c9d299a11ce
I20260805 22:37:15.539856 21461 ts_tablet_manager.cc:1939] T cc3d234ce65643febb960c9d299a11ce P 59695b623295459e94d1c0beb0818c3b: Deleting consensus metadata
I20260805 22:37:15.540675 21434 tablet_bootstrap.cc:492] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b: Bootstrap starting.
I20260805 22:37:15.540894 21343 tablet_service.cc:1467] Processing CreateTablet for tablet 54df5e56545643f38c1efcdb78d0da0a (DEFAULT_TABLE table=test-table [id=57dc602a1dfc44789588e4fb4a3672ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:15.541018 21343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54df5e56545643f38c1efcdb78d0da0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:15.541100 21434 tablet_bootstrap.cc:654] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:15.541671 21435 tablet_bootstrap.cc:492] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81: Bootstrap starting.
I20260805 22:37:15.542080 21435 tablet_bootstrap.cc:654] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:15.542174 21438 tablet_bootstrap.cc:492] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e: Bootstrap starting.
I20260805 22:37:15.542513 20898 catalog_manager.cc:4841] TS 59695b623295459e94d1c0beb0818c3b (127.19.77.129:42157): tablet cc3d234ce65643febb960c9d299a11ce (table test-table [id=da9de18cdda24ff082a29e4c1e75622b]) successfully deleted
I20260805 22:37:15.542562 21460 ts_tablet_manager.cc:1918] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:15.542634 21460 log.cc:1196] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/cc3d234ce65643febb960c9d299a11ce
I20260805 22:37:15.542795 21438 tablet_bootstrap.cc:654] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:15.542953 21460 ts_tablet_manager.cc:1939] T cc3d234ce65643febb960c9d299a11ce P 6c002be1de3743d0a7135b2f93ea3b81: Deleting consensus metadata
I20260805 22:37:15.540894 21459 ts_tablet_manager.cc:1918] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:15.543078 21459 log.cc:1196] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/cc3d234ce65643febb960c9d299a11ce
I20260805 22:37:15.543423 21459 ts_tablet_manager.cc:1939] T cc3d234ce65643febb960c9d299a11ce P 1a60e1096d6e472abbd2a30a2c8adf0e: Deleting consensus metadata
I20260805 22:37:15.543399 20899 catalog_manager.cc:4841] TS 6c002be1de3743d0a7135b2f93ea3b81 (127.19.77.130:45061): tablet cc3d234ce65643febb960c9d299a11ce (table test-table [id=da9de18cdda24ff082a29e4c1e75622b]) successfully deleted
I20260805 22:37:15.543841 21435 tablet_bootstrap.cc:492] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81: No bootstrap required, opened a new log
I20260805 22:37:15.543829 20898 catalog_manager.cc:4841] TS 1a60e1096d6e472abbd2a30a2c8adf0e (127.19.77.131:39457): tablet cc3d234ce65643febb960c9d299a11ce (table test-table [id=da9de18cdda24ff082a29e4c1e75622b]) successfully deleted
I20260805 22:37:15.543896 21435 ts_tablet_manager.cc:1397] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:15.544231 21435 raft_consensus.cc:348] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.544319 21435 raft_consensus.cc:374] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:15.544341 21435 raft_consensus.cc:729] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c002be1de3743d0a7135b2f93ea3b81, State: Initialized, Role: FOLLOWER
I20260805 22:37:15.544384 21435 consensus_queue.cc:260] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.544489 21435 ts_tablet_manager.cc:1428] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:15.545208 21438 tablet_bootstrap.cc:492] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e: No bootstrap required, opened a new log
I20260805 22:37:15.545204 21434 tablet_bootstrap.cc:492] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b: No bootstrap required, opened a new log
I20260805 22:37:15.545258 21434 ts_tablet_manager.cc:1397] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260805 22:37:15.545258 21438 ts_tablet_manager.cc:1397] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260805 22:37:15.545405 21438 raft_consensus.cc:348] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.545405 21434 raft_consensus.cc:348] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.545472 21434 raft_consensus.cc:374] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:15.545472 21438 raft_consensus.cc:374] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:15.545495 21438 raft_consensus.cc:729] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a60e1096d6e472abbd2a30a2c8adf0e, State: Initialized, Role: FOLLOWER
I20260805 22:37:15.545495 21434 raft_consensus.cc:729] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59695b623295459e94d1c0beb0818c3b, State: Initialized, Role: FOLLOWER
I20260805 22:37:15.545544 21438 consensus_queue.cc:260] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.545547 21434 consensus_queue.cc:260] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.545634 21434 ts_tablet_manager.cc:1428] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:15.545655 21438 ts_tablet_manager.cc:1428] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:15.583065 21455 raft_consensus.cc:482] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:15.583220 21455 raft_consensus.cc:504] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.583484 21455 leader_election.cc:288] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c002be1de3743d0a7135b2f93ea3b81 (127.19.77.130:45061), 1a60e1096d6e472abbd2a30a2c8adf0e (127.19.77.131:39457)
I20260805 22:37:15.583791 21363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54df5e56545643f38c1efcdb78d0da0a" candidate_uuid: "59695b623295459e94d1c0beb0818c3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" is_pre_election: true
I20260805 22:37:15.583920 21363 raft_consensus.cc:2454] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59695b623295459e94d1c0beb0818c3b in term 0.
I20260805 22:37:15.583858 21218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54df5e56545643f38c1efcdb78d0da0a" candidate_uuid: "59695b623295459e94d1c0beb0818c3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c002be1de3743d0a7135b2f93ea3b81" is_pre_election: true
I20260805 22:37:15.584064 21218 raft_consensus.cc:2454] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59695b623295459e94d1c0beb0818c3b in term 0.
I20260805 22:37:15.584127 21006 leader_election.cc:302] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a60e1096d6e472abbd2a30a2c8adf0e, 59695b623295459e94d1c0beb0818c3b; no voters:
I20260805 22:37:15.584236 21455 raft_consensus.cc:2781] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:15.584275 21455 raft_consensus.cc:482] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:15.584303 21455 raft_consensus.cc:3037] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:15.585105 21455 raft_consensus.cc:504] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.585425 21455 leader_election.cc:288] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [CANDIDATE]: Term 1 election: Requested vote from peers 6c002be1de3743d0a7135b2f93ea3b81 (127.19.77.130:45061), 1a60e1096d6e472abbd2a30a2c8adf0e (127.19.77.131:39457)
I20260805 22:37:15.585480 21363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54df5e56545643f38c1efcdb78d0da0a" candidate_uuid: "59695b623295459e94d1c0beb0818c3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e"
I20260805 22:37:15.585592 21363 raft_consensus.cc:3037] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:15.585579 21218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54df5e56545643f38c1efcdb78d0da0a" candidate_uuid: "59695b623295459e94d1c0beb0818c3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c002be1de3743d0a7135b2f93ea3b81"
I20260805 22:37:15.585669 21218 raft_consensus.cc:3037] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:15.586403 21218 raft_consensus.cc:2454] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59695b623295459e94d1c0beb0818c3b in term 1.
I20260805 22:37:15.586438 21363 raft_consensus.cc:2454] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59695b623295459e94d1c0beb0818c3b in term 1.
I20260805 22:37:15.586634 21007 leader_election.cc:302] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59695b623295459e94d1c0beb0818c3b, 6c002be1de3743d0a7135b2f93ea3b81; no voters:
I20260805 22:37:15.586737 21455 raft_consensus.cc:2781] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:15.586808 21455 raft_consensus.cc:686] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 1 LEADER]: Becoming Leader. State: Replica: 59695b623295459e94d1c0beb0818c3b, State: Running, Role: LEADER
I20260805 22:37:15.586862 21455 consensus_queue.cc:237] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.587699 20912 catalog_manager.cc:5495] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 59695b623295459e94d1c0beb0818c3b (127.19.77.129). New cstate: current_term: 1 leader_uuid: "59695b623295459e94d1c0beb0818c3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } health_report { overall_health: UNKNOWN } } }
Aug 05 22:37:15 dist-test-slave-chsk krb5kdc[20866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:15.624866 21472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.612239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43798 (local address 127.19.77.190:40175)
0805 22:37:15.612467 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.612470 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.612498 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:37:15.612525 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.612526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.612538 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.612612 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:15.613300 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.614018 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.615097 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.615408 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.615474 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.621673 (+ 6199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:15.621675 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:15.621675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:15.621684 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:15.623492 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.623940 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.623941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.623942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.624007 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.624226 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.624227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.624227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.624352 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:15.624428 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.624599 (+ 171us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.624726 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":177,"threads_started":1}
I20260805 22:37:15.625070 21471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.612129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40175 (local address 127.0.0.1:43798)
0805 22:37:15.612329 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.612343 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.612418 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.612647 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.612648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.613083 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:15.613154 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.613158 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.614109 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.614110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.614952 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.614954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.615489 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.615491 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.615555 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.619634 (+ 4079us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:15.619641 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:15.621531 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:15.623608 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:15.623622 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:15.623624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:15.623846 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:15.624082 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:15.624083 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:15.624083 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:15.624145 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:15.624429 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:15.624438 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:15.624483 (+ 45us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.624574 (+ 91us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.624787 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":96,"thread_start_us":101,"threads_started":1}
I20260805 22:37:15.627447 20912 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:43798:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 22:37:15.627722 20912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:15.630103 21343 tablet_service.cc:1467] Processing CreateTablet for tablet 07f23234629044f089423ad74f897aef (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2aace00c26a4f67b3b2c262f57413e6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:37:15.630306 21343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07f23234629044f089423ad74f897aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:15.630321 21054 tablet_service.cc:1467] Processing CreateTablet for tablet 07f23234629044f089423ad74f897aef (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2aace00c26a4f67b3b2c262f57413e6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:37:15.630446 21054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07f23234629044f089423ad74f897aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:15.631837 21434 tablet_bootstrap.cc:492] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: Bootstrap starting.
I20260805 22:37:15.632189 21198 tablet_service.cc:1467] Processing CreateTablet for tablet 07f23234629044f089423ad74f897aef (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2aace00c26a4f67b3b2c262f57413e6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:37:15.632334 21198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07f23234629044f089423ad74f897aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:15.632826 21434 tablet_bootstrap.cc:654] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:15.633934 21434 tablet_bootstrap.cc:492] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: No bootstrap required, opened a new log
I20260805 22:37:15.633982 21434 ts_tablet_manager.cc:1397] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:37:15.634004 21438 tablet_bootstrap.cc:492] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: Bootstrap starting.
I20260805 22:37:15.634384 21434 raft_consensus.cc:348] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.634467 21434 raft_consensus.cc:374] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:15.634482 21434 raft_consensus.cc:729] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59695b623295459e94d1c0beb0818c3b, State: Initialized, Role: FOLLOWER
I20260805 22:37:15.634546 21434 consensus_queue.cc:260] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.634754 21434 ts_tablet_manager.cc:1428] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260805 22:37:15.634756 21438 tablet_bootstrap.cc:654] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:15.635277 21455 tablet_replica.cc:439] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } }
I20260805 22:37:15.635365 21455 tablet_replica.cc:442] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:15.635476 21435 tablet_bootstrap.cc:492] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: Bootstrap starting.
I20260805 22:37:15.635893 21435 tablet_bootstrap.cc:654] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:15.635919 21438 tablet_bootstrap.cc:492] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: No bootstrap required, opened a new log
I20260805 22:37:15.635965 21438 ts_tablet_manager.cc:1397] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260805 22:37:15.636298 21438 raft_consensus.cc:348] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.636389 21438 raft_consensus.cc:374] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:15.636416 21438 raft_consensus.cc:729] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a60e1096d6e472abbd2a30a2c8adf0e, State: Initialized, Role: FOLLOWER
I20260805 22:37:15.636462 21438 consensus_queue.cc:260] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.636575 21438 ts_tablet_manager.cc:1428] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:15.636730 21442 tablet_replica.cc:439] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } }
I20260805 22:37:15.636871 21442 tablet_replica.cc:442] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:15.637436 21435 tablet_bootstrap.cc:492] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: No bootstrap required, opened a new log
I20260805 22:37:15.637496 21435 ts_tablet_manager.cc:1397] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:15.637905 21435 raft_consensus.cc:348] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.638002 21435 raft_consensus.cc:374] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:15.638079 21435 raft_consensus.cc:729] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c002be1de3743d0a7135b2f93ea3b81, State: Initialized, Role: FOLLOWER
I20260805 22:37:15.638141 21435 consensus_queue.cc:260] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.638253 21435 ts_tablet_manager.cc:1428] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260805 22:37:15.638410 21441 tablet_replica.cc:439] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } }
I20260805 22:37:15.638526 21441 tablet_replica.cc:442] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:15.790269 21442 raft_consensus.cc:482] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:15.790393 21442 raft_consensus.cc:504] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.790776 21442 leader_election.cc:288] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59695b623295459e94d1c0beb0818c3b (127.19.77.129:42157), 6c002be1de3743d0a7135b2f93ea3b81 (127.19.77.130:45061)
I20260805 22:37:15.794859 21430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.791091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:52417 (local address 127.19.77.130:45061)
0805 22:37:15.791173 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.791175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.791321 (+ 146us) server_negotiation.cc:407] Connection header received
0805 22:37:15.791402 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.791403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.791415 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.791483 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:15.791785 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.792244 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.793826 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.794386 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.794482 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.794493 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.794737 (+ 244us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.794778 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:37:15.794858 21433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.791183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:35781 (local address 127.19.77.129:42157)
0805 22:37:15.791236 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.791238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.791284 (+ 46us) server_negotiation.cc:407] Connection header received
0805 22:37:15.791398 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.791399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.791412 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.791472 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:15.791684 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.792225 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.793812 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.794419 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.794487 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.794493 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.794736 (+ 243us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.794778 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:37:15.794909 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.790967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:45061 (local address 127.19.77.131:52417)
0805 22:37:15.791235 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.791246 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.791317 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.791498 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.791499 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.791502 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:15.791698 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.791701 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.792364 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.792364 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.793743 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.793745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.794546 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.794548 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.794638 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.794646 (+ 8us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.794716 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.794779 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":150,"spinlock_wait_cycles":768,"thread_start_us":117,"threads_started":1}
I20260805 22:37:15.794909 21477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.791001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42157 (local address 127.19.77.131:35781)
0805 22:37:15.791214 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.791225 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.791316 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.791488 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.791489 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.791492 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:15.791592 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.791594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.792315 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.792316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.793714 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.793718 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.794546 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.794548 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.794638 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.794647 (+ 9us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.794716 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.794779 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":47,"thread_start_us":100,"threads_started":1}
I20260805 22:37:15.795426 21074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f23234629044f089423ad74f897aef" candidate_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59695b623295459e94d1c0beb0818c3b" is_pre_election: true
I20260805 22:37:15.795476 21218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f23234629044f089423ad74f897aef" candidate_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c002be1de3743d0a7135b2f93ea3b81" is_pre_election: true
I20260805 22:37:15.795569 21218 raft_consensus.cc:2454] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a60e1096d6e472abbd2a30a2c8adf0e in term 0.
I20260805 22:37:15.795609 21074 raft_consensus.cc:2454] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a60e1096d6e472abbd2a30a2c8adf0e in term 0.
I20260805 22:37:15.795841 21294 leader_election.cc:302] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a60e1096d6e472abbd2a30a2c8adf0e, 6c002be1de3743d0a7135b2f93ea3b81; no voters:
I20260805 22:37:15.796136 21442 raft_consensus.cc:2781] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:15.796200 21442 raft_consensus.cc:482] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:15.796217 21442 raft_consensus.cc:3037] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:15.797132 21442 raft_consensus.cc:504] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.797317 21442 leader_election.cc:288] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [CANDIDATE]: Term 1 election: Requested vote from peers 59695b623295459e94d1c0beb0818c3b (127.19.77.129:42157), 6c002be1de3743d0a7135b2f93ea3b81 (127.19.77.130:45061)
I20260805 22:37:15.797504 21218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f23234629044f089423ad74f897aef" candidate_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c002be1de3743d0a7135b2f93ea3b81"
I20260805 22:37:15.797564 21074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07f23234629044f089423ad74f897aef" candidate_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59695b623295459e94d1c0beb0818c3b"
I20260805 22:37:15.797628 21218 raft_consensus.cc:3037] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:15.797638 21074 raft_consensus.cc:3037] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:15.798482 21218 raft_consensus.cc:2454] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a60e1096d6e472abbd2a30a2c8adf0e in term 1.
I20260805 22:37:15.798601 21074 raft_consensus.cc:2454] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a60e1096d6e472abbd2a30a2c8adf0e in term 1.
I20260805 22:37:15.798684 21294 leader_election.cc:302] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a60e1096d6e472abbd2a30a2c8adf0e, 6c002be1de3743d0a7135b2f93ea3b81; no voters:
I20260805 22:37:15.798775 21442 raft_consensus.cc:2781] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:15.798976 21442 raft_consensus.cc:686] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 LEADER]: Becoming Leader. State: Replica: 1a60e1096d6e472abbd2a30a2c8adf0e, State: Running, Role: LEADER
I20260805 22:37:15.799077 21442 consensus_queue.cc:237] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } }
I20260805 22:37:15.799475 21478 tablet_replica.cc:439] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: TxnStatusTablet state changed. Reason: New leader 1a60e1096d6e472abbd2a30a2c8adf0e. Latest consensus state: current_term: 1 leader_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } }
I20260805 22:37:15.799571 21478 tablet_replica.cc:442] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:37:15.799783 21480 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 22:37:15.799921 21480 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 22:37:15.800169 20912 catalog_manager.cc:5495] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a60e1096d6e472abbd2a30a2c8adf0e (127.19.77.131). New cstate: current_term: 1 leader_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } health_report { overall_health: HEALTHY } } }
I20260805 22:37:15.821336 21471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.818497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:39457 (local address 127.0.0.1:43048)
0805 22:37:15.818590 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.818603 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.818671 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.818892 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.818893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.818894 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:15.818958 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.818963 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.819756 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.819758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.820363 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.820365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.820747 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.820748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.820816 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.820845 (+ 29us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:15.821143 (+ 298us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:15.821155 (+ 12us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.821206 (+ 51us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.821266 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260805 22:37:15.821321 21431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.818593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43048 (local address 127.19.77.131:39457)
0805 22:37:15.818672 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.818675 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.818685 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:15.818766 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.818767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.818796 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.818884 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:15.819042 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.819656 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.820457 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.820666 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.820763 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.820951 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:15.821063 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:15.821153 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.821210 (+ 57us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.821233 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260805 22:37:15.822718 21218 raft_consensus.cc:1261] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81 [term 1 FOLLOWER]: Refusing update from remote peer 1a60e1096d6e472abbd2a30a2c8adf0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:15.822846 21074 raft_consensus.cc:1261] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b [term 1 FOLLOWER]: Refusing update from remote peer 1a60e1096d6e472abbd2a30a2c8adf0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:15.823014 21478 consensus_queue.cc:1035] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:15.823184 21442 consensus_queue.cc:1035] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:15.823868 21455 tablet_replica.cc:439] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: TxnStatusTablet state changed. Reason: New leader 1a60e1096d6e472abbd2a30a2c8adf0e. Latest consensus state: current_term: 1 leader_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } }
I20260805 22:37:15.823961 21455 tablet_replica.cc:442] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:15.823940 21441 tablet_replica.cc:439] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: TxnStatusTablet state changed. Reason: New leader 1a60e1096d6e472abbd2a30a2c8adf0e. Latest consensus state: current_term: 1 leader_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } }
I20260805 22:37:15.824039 21441 tablet_replica.cc:442] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:15.824944 21478 tablet_replica.cc:439] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } }
I20260805 22:37:15.825047 21478 tablet_replica.cc:442] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:37:15.825103 21478 tablet_replica.cc:439] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } }
I20260805 22:37:15.825143 21478 tablet_replica.cc:442] T 07f23234629044f089423ad74f897aef P 1a60e1096d6e472abbd2a30a2c8adf0e: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:37:15.825250 21455 tablet_replica.cc:439] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } }
I20260805 22:37:15.825340 21455 tablet_replica.cc:442] T 07f23234629044f089423ad74f897aef P 59695b623295459e94d1c0beb0818c3b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:15.825832 21441 tablet_replica.cc:439] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59695b623295459e94d1c0beb0818c3b" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42157 } } peers { permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 } } peers { permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 } } }
I20260805 22:37:15.825923 21441 tablet_replica.cc:442] T 07f23234629044f089423ad74f897aef P 6c002be1de3743d0a7135b2f93ea3b81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:15.832446 21488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.829755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:39457 (local address 127.19.77.129:50051)
0805 22:37:15.829953 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.829962 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.830075 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.830215 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.830215 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.830217 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:15.830275 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.830277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.830913 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.830915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.831596 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.831598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.831978 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.831979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.832045 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.832059 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:15.832262 (+ 203us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:15.832264 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.832318 (+ 54us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.832369 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":89,"threads_started":1}
I20260805 22:37:15.832429 21431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.829824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:50051 (local address 127.19.77.131:39457)
0805 22:37:15.829875 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.829877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.830026 (+ 149us) server_negotiation.cc:407] Connection header received
0805 22:37:15.830143 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.830144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.830154 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.830211 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:15.830335 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.830821 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.831686 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.831899 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.831978 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.832157 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:15.832190 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:15.832262 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.832322 (+ 60us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.832345 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:37:15.835556 21363 raft_consensus.cc:1261] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 FOLLOWER]: Refusing update from remote peer 59695b623295459e94d1c0beb0818c3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:15.835611 21218 raft_consensus.cc:1261] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81 [term 1 FOLLOWER]: Refusing update from remote peer 59695b623295459e94d1c0beb0818c3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:15.835804 21446 consensus_queue.cc:1035] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a60e1096d6e472abbd2a30a2c8adf0e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 39457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:15.835899 21455 consensus_queue.cc:1035] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c002be1de3743d0a7135b2f93ea3b81" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 45061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:15.845717 21433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.842535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:37343 (local address 127.19.77.129:42157)
0805 22:37:15.842578 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.842580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.842800 (+ 220us) server_negotiation.cc:407] Connection header received
0805 22:37:15.842865 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.842866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.842875 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.842917 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:15.843081 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.843710 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.844862 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.845178 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.845252 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.845448 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:15.845486 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:15.845540 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.845609 (+ 69us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.845634 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:37:15.845748 21492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.842467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42157 (local address 127.19.77.131:37343)
0805 22:37:15.842729 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:15.842741 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:15.842806 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:15.842931 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:15.842932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:15.842934 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:15.843026 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.843028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.843804 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.843806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.844760 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:15.844763 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.845263 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.845264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:15.845336 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.845356 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:15.845555 (+ 199us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:15.845557 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:37:15.845606 (+ 49us) client_negotiation.cc:240] Negotiation successful
0805 22:37:15.845653 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":179,"threads_started":1}
I20260805 22:37:15.853969 20912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:15.854120 20912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:15.854758 20912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e480d33131014a8ab111962afcab66c6: Sending DeleteTablet for 3 replicas of tablet 54df5e56545643f38c1efcdb78d0da0a
I20260805 22:37:15.855054 21198 tablet_service.cc:1514] Processing DeleteTablet for tablet 54df5e56545643f38c1efcdb78d0da0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:15 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:56740
I20260805 22:37:15.855198 21460 tablet_replica.cc:330] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81: stopping tablet replica
I20260805 22:37:15.855265 21460 raft_consensus.cc:2229] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:15.855258 21343 tablet_service.cc:1514] Processing DeleteTablet for tablet 54df5e56545643f38c1efcdb78d0da0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:15 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:43046
I20260805 22:37:15.855304 21460 raft_consensus.cc:2258] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:15.855350 21459 tablet_replica.cc:330] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e: stopping tablet replica
I20260805 22:37:15.855408 21459 raft_consensus.cc:2229] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:15.855438 21459 raft_consensus.cc:2258] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:15.855469 21054 tablet_service.cc:1514] Processing DeleteTablet for tablet 54df5e56545643f38c1efcdb78d0da0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:15 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:59938
I20260805 22:37:15.855628 21461 tablet_replica.cc:330] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b: stopping tablet replica
I20260805 22:37:15.855677 21461 raft_consensus.cc:2229] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:15.855762 21461 raft_consensus.cc:2258] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:15.856179 21460 ts_tablet_manager.cc:1905] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:15.857522 21461 ts_tablet_manager.cc:1905] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:15.857944 21460 ts_tablet_manager.cc:1918] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:15.858016 21460 log.cc:1196] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/54df5e56545643f38c1efcdb78d0da0a
I20260805 22:37:15.858240 21460 ts_tablet_manager.cc:1939] T 54df5e56545643f38c1efcdb78d0da0a P 6c002be1de3743d0a7135b2f93ea3b81: Deleting consensus metadata
I20260805 22:37:15.858599 20899 catalog_manager.cc:4841] TS 6c002be1de3743d0a7135b2f93ea3b81 (127.19.77.130:45061): tablet 54df5e56545643f38c1efcdb78d0da0a (table test-table [id=57dc602a1dfc44789588e4fb4a3672ae]) successfully deleted
I20260805 22:37:15.859404 21461 ts_tablet_manager.cc:1918] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:15.859483 21461 log.cc:1196] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/54df5e56545643f38c1efcdb78d0da0a
I20260805 22:37:15.859702 21461 ts_tablet_manager.cc:1939] T 54df5e56545643f38c1efcdb78d0da0a P 59695b623295459e94d1c0beb0818c3b: Deleting consensus metadata
I20260805 22:37:15.860108 21459 ts_tablet_manager.cc:1905] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:15.860625 20898 catalog_manager.cc:4841] TS 59695b623295459e94d1c0beb0818c3b (127.19.77.129:42157): tablet 54df5e56545643f38c1efcdb78d0da0a (table test-table [id=57dc602a1dfc44789588e4fb4a3672ae]) successfully deleted
I20260805 22:37:15.861738 21459 ts_tablet_manager.cc:1918] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:15.861815 21459 log.cc:1196] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/54df5e56545643f38c1efcdb78d0da0a
I20260805 22:37:15.862100 21459 ts_tablet_manager.cc:1939] T 54df5e56545643f38c1efcdb78d0da0a P 1a60e1096d6e472abbd2a30a2c8adf0e: Deleting consensus metadata
I20260805 22:37:15.862452 20898 catalog_manager.cc:4841] TS 1a60e1096d6e472abbd2a30a2c8adf0e (127.19.77.131:39457): tablet 54df5e56545643f38c1efcdb78d0da0a (table test-table [id=57dc602a1dfc44789588e4fb4a3672ae]) successfully deleted
Aug 05 22:37:15 dist-test-slave-chsk krb5kdc[20866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969435, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:37:15.867225 21433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.856103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59966 (local address 127.19.77.129:42157)
0805 22:37:15.856146 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.856148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.856596 (+ 448us) server_negotiation.cc:407] Connection header received
0805 22:37:15.856698 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.856699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.856713 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.856743 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:15.857551 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.858331 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.859526 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.859821 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.859866 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.863787 (+ 3921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:15.863804 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:15.863804 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:15.863813 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:15.865885 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.866318 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.866322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.866323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.866397 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.866590 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.866591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.866592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.866784 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:15.866933 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.866978 (+ 45us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.867085 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260805 22:37:15.867550 21116 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59966
I20260805 22:37:15.876538 21472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:15.868697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43812 (local address 127.19.77.190:40175)
0805 22:37:15.868747 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:15.868749 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:15.868894 (+ 145us) server_negotiation.cc:407] Connection header received
0805 22:37:15.868932 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:15.868933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:15.868944 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:15.869026 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:15.869556 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.870368 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.871090 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:15.871444 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:15.871519 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:15.872858 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:15.872860 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:15.872860 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:15.872869 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:15.874631 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.875109 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.875110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.875111 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.875246 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:15.875774 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:15.875775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:15.875776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:15.875939 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:15.876077 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:15.876333 (+ 256us) server_negotiation.cc:299] Negotiation successful
0805 22:37:15.876439 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260805 22:37:15.876875 20912 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43812
I20260805 22:37:15.877578 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 20987
I20260805 22:37:15.889833 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 21131
I20260805 22:37:15.899032 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 21275
I20260805 22:37:15.906041 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 20879
2026-08-05T22:37:15Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2832 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:15 dist-test-slave-chsk krb5kdc[21500](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:15 dist-test-slave-chsk krb5kdc[21500](info): set up 2 sockets
Aug 05 22:37:15 dist-test-slave-chsk krb5kdc[21500](info): commencing operation
krb5kdc: starting...
W20260805 22:37:16.963052 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:17.099056 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:44387
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:34375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:44387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:17.187875 21514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:17.188180 21514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:17.188222 21514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:17.189522 21514 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:17.189610 21514 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 22:37:17.189635 21514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:17.189658 21514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:17.189687 21514 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:17.189720 21514 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:17.191512 21514 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:34375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:44387
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:44387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:17.191843 21514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:17.192112 21514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:17.197446 21521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:17.197476 21523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:17.197654 21514 server_base.cc:1034] running on GCE node
W20260805 22:37:17.197446 21520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:17.198002 21514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:17.198328 21514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:17.199503 21514 hybrid_clock.cc:648] HybridClock initialized: now 1785969437199472 us; error 46 us; skew 500 ppm
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:17.202360 21514 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:17.202909 21514 webserver.cc:460] Webserver started at http://127.19.77.190:36159/ using document root <none> and password file <none>
I20260805 22:37:17.203251 21514 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:17.203306 21514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:17.203469 21514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:17.204640 21514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "f73b148e01d144fb9f32face58421bb5"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "5d475c75abc20a4c69721285cd3f2e5d"
server_key_iv: "e3aa6dca4ae25e545570c24c193f53d8"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.205034 21514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "f73b148e01d144fb9f32face58421bb5"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "5d475c75abc20a4c69721285cd3f2e5d"
server_key_iv: "e3aa6dca4ae25e545570c24c193f53d8"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.206529 21514 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:17.207422 21530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.207654 21514 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:17.207754 21514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "f73b148e01d144fb9f32face58421bb5"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "5d475c75abc20a4c69721285cd3f2e5d"
server_key_iv: "e3aa6dca4ae25e545570c24c193f53d8"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.207839 21514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:17.220131 21514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:17.222548 21514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:17.222735 21514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:17.228679 21514 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:44387
I20260805 22:37:17.228742 21593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:44387 every 8 connection(s)
I20260805 22:37:17.229156 21514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:17.229984 21594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:17.232509 21594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5: Bootstrap starting.
I20260805 22:37:17.233211 21594 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:17.233547 21594 log.cc:824] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:17.234344 21594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5: No bootstrap required, opened a new log
I20260805 22:37:17.235981 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 21514
I20260805 22:37:17.236106 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:17.236296 19766 external_mini_cluster.cc:1428] Setting key 776d765f81e82066435838afe7150477
I20260805 22:37:17.237133 21594 raft_consensus.cc:348] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73b148e01d144fb9f32face58421bb5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44387 } }
I20260805 22:37:17.237349 21594 raft_consensus.cc:374] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:17.237389 21594 raft_consensus.cc:729] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f73b148e01d144fb9f32face58421bb5, State: Initialized, Role: FOLLOWER
I20260805 22:37:17.237534 21594 consensus_queue.cc:260] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73b148e01d144fb9f32face58421bb5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44387 } }
I20260805 22:37:17.237639 21594 raft_consensus.cc:388] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:17.237676 21594 raft_consensus.cc:482] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:17.237726 21594 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:17.238431 21594 raft_consensus.cc:504] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73b148e01d144fb9f32face58421bb5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44387 } }
I20260805 22:37:17.238545 21594 leader_election.cc:302] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f73b148e01d144fb9f32face58421bb5; no voters:
I20260805 22:37:17.238721 21594 leader_election.cc:288] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:17.238798 21599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:17.238970 21599 raft_consensus.cc:686] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [term 1 LEADER]: Becoming Leader. State: Replica: f73b148e01d144fb9f32face58421bb5, State: Running, Role: LEADER
I20260805 22:37:17.239018 21594 sys_catalog.cc:564] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:17.239078 21599 consensus_queue.cc:237] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73b148e01d144fb9f32face58421bb5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44387 } }
I20260805 22:37:17.239486 21600 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f73b148e01d144fb9f32face58421bb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73b148e01d144fb9f32face58421bb5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44387 } } }
I20260805 22:37:17.239585 21600 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:17.239475 21601 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f73b148e01d144fb9f32face58421bb5. Latest consensus state: current_term: 1 leader_uuid: "f73b148e01d144fb9f32face58421bb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73b148e01d144fb9f32face58421bb5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44387 } } }
I20260805 22:37:17.239748 21601 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:17.239923 21605 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:17.241091 21605 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:17.242928 21605 catalog_manager.cc:1347] Generated new cluster ID: fe5abe17b36349929cc816cabd0e7d36
I20260805 22:37:17.242992 21605 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:17.248027 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.236966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41462 (local address 127.19.77.190:44387)
0805 22:37:17.237188 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.237198 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.237239 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:37:17.237440 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.237448 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.237511 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.237713 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:17.238400 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.240045 (+ 1645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.241133 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.241604 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.241744 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.244509 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:17.244513 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:17.244513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:17.244526 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:17.246350 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.246757 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.246760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.246761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.246870 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.247093 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.247094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.247094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.247417 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:17.247611 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.247685 (+ 74us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.247841 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":97,"threads_started":1}
I20260805 22:37:17.255735 21605 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:17.256510 21605 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:17.260938 21605 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5: Generated new TSK 0
I20260805 22:37:17.261169 21605 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:37:17.297873 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:44387
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:34375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:17.386204 21620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:17.386483 21620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:17.386530 21620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:17.387887 21620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:17.387979 21620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:17.388027 21620 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 22:37:17.388060 21620 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:37:17.388096 21620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:17.389797 21620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:34375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.77.190:44387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:17.390125 21620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:17.390395 21620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:17.395879 21626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:17.395881 21625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:17.396031 21620 server_base.cc:1034] running on GCE node
W20260805 22:37:17.395877 21628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:17.396318 21620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:17.396636 21620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:17.397817 21620 hybrid_clock.cc:648] HybridClock initialized: now 1785969437397795 us; error 41 us; skew 500 ppm
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:17.400676 21620 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:37:17.401255 21620 webserver.cc:460] Webserver started at http://127.19.77.129:40975/ using document root <none> and password file <none>
I20260805 22:37:17.401473 21620 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:17.401520 21620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:17.401618 21620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:17.402684 21620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "f5ac6bcdf229473d8c75819a250d3b61"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "319d7d11431bebf66207fb6c595a6eca"
server_key_iv: "f100f4e960738ad58c0cead9a4e35045"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.403005 21620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "f5ac6bcdf229473d8c75819a250d3b61"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "319d7d11431bebf66207fb6c595a6eca"
server_key_iv: "f100f4e960738ad58c0cead9a4e35045"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.404700 21620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:17.405759 21635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.406015 21620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:17.406152 21620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "f5ac6bcdf229473d8c75819a250d3b61"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "319d7d11431bebf66207fb6c595a6eca"
server_key_iv: "f100f4e960738ad58c0cead9a4e35045"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.406239 21620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:17.416870 21620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:17.419570 21620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:17.419708 21620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:17.420243 21620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:17.420285 21620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.420310 21620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:17.420325 21620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.427404 21620 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:44965
I20260805 22:37:17.427462 21753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:44965 every 8 connection(s)
I20260805 22:37:17.427805 21620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:17.431823 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.420930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:54153 (local address 127.19.77.190:44387)
0805 22:37:17.420978 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.420981 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.421252 (+ 271us) server_negotiation.cc:407] Connection header received
0805 22:37:17.421826 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.421828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.421846 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.421899 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:17.422881 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.423789 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.425470 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.425697 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.425782 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.428656 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:17.428657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:17.428658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:17.428666 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:17.430144 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.430690 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.430692 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.430692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.430758 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.431034 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.431035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.431035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.431240 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:17.431319 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.431628 (+ 309us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.431726 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:37:17.432044 21644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.420902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:44387 (local address 127.19.77.129:54153)
0805 22:37:17.421117 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.421156 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.421726 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.422003 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.422009 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.422425 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:17.422745 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.422751 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.423935 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.423937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.425377 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.425381 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.425792 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.425793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.425958 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.426698 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:17.426710 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:17.428533 (+ 1823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:17.430284 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.430296 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.430298 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.430565 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.430833 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.430834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.430834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.430961 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.431310 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:17.431319 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:17.431478 (+ 159us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.431598 (+ 120us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.431779 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":101,"threads_started":1}
I20260805 22:37:17.432693 21755 heartbeater.cc:347] Connected to a master server at 127.19.77.190:44387
I20260805 22:37:17.432786 21755 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:17.432999 21755 heartbeater.cc:511] Master 127.19.77.190:44387 requested a full tablet report, sending...
I20260805 22:37:17.433609 21546 ts_manager.cc:194] Registered new tserver with Master: f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965)
I20260805 22:37:17.434450 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 21620
I20260805 22:37:17.434558 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:17.434633 21546 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:54153
I20260805 22:37:17.434746 19766 external_mini_cluster.cc:1428] Setting key 1bb7573b6931c1dc482dd146737044e0
I20260805 22:37:17.441192 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.433936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:47605 (local address 127.19.77.190:44387)
0805 22:37:17.433983 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.433986 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.434131 (+ 145us) server_negotiation.cc:407] Connection header received
0805 22:37:17.434177 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.434178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.434186 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.434228 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:17.434633 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.435553 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.436553 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.436753 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.436810 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.437905 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:17.437906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:17.437907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:17.437916 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:17.439878 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.440271 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.440272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.440272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.440351 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.440548 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.440549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.440549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.440724 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:17.440799 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.440987 (+ 188us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.441080 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":184,"server-negotiator.queue_time_us":20}
I20260805 22:37:17.441192 21761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.433872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:44387 (local address 127.19.77.129:47605)
0805 22:37:17.434050 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.434063 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.434129 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.434253 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.434254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.434467 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:17.434538 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.434539 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.435665 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.435666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.436463 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.436467 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.436833 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.436834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.436915 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.437415 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:17.437421 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:17.437807 (+ 386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:17.439991 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.439992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.439993 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.440187 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.440425 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.440426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.440426 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.440483 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.440801 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:17.440802 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:17.440857 (+ 55us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.440953 (+ 96us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.441083 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":102,"threads_started":1}
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:37:17.466488 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:44387
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:34375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:17.553395 21764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:17.553647 21764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:17.553692 21764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:17.554864 21764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:17.554934 21764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:17.554970 21764 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 22:37:17.554999 21764 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:37:17.555034 21764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:17.556543 21764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:34375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.77.190:44387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:17.556825 21764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:17.557072 21764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:17.562247 21772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:17.562266 21770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:17.562286 21769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:17.562429 21764 server_base.cc:1034] running on GCE node
I20260805 22:37:17.562656 21764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:17.562871 21764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:17.564007 21764 hybrid_clock.cc:648] HybridClock initialized: now 1785969437563977 us; error 47 us; skew 500 ppm
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:17.566499 21764 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:37:17.567057 21764 webserver.cc:460] Webserver started at http://127.19.77.130:46479/ using document root <none> and password file <none>
I20260805 22:37:17.567349 21764 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:17.567399 21764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:17.567571 21764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:17.568672 21764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "4eeb459c63f045a9b1179d6c272c32d1"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "b0820725cebbd9d04b46ed51f169dc49"
server_key_iv: "87aab672799664dea992846e6272397b"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.569056 21764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "4eeb459c63f045a9b1179d6c272c32d1"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "b0820725cebbd9d04b46ed51f169dc49"
server_key_iv: "87aab672799664dea992846e6272397b"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.570518 21764 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:17.571427 21779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.571622 21764 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:17.571728 21764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "4eeb459c63f045a9b1179d6c272c32d1"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "b0820725cebbd9d04b46ed51f169dc49"
server_key_iv: "87aab672799664dea992846e6272397b"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.571816 21764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:17.583846 21764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:17.586097 21764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:17.586298 21764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:17.586987 21764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:17.587041 21764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.587080 21764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:17.587129 21764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.595028 21764 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:39487
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:17.595104 21897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:39487 every 8 connection(s)
I20260805 22:37:17.595465 21764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:17.598588 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.587460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:50499 (local address 127.19.77.190:44387)
0805 22:37:17.587532 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.587535 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.587873 (+ 338us) server_negotiation.cc:407] Connection header received
0805 22:37:17.588655 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.588657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.588672 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.588740 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:17.589722 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.590262 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.592048 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.592372 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.592448 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.595745 (+ 3297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:17.595747 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:17.595748 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:17.595757 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:17.597433 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.597841 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.597842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.597842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.597895 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.598076 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.598077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.598077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.598189 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:17.598249 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.598446 (+ 197us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.598511 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:37:17.598852 21789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.587452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:44387 (local address 127.19.77.130:50499)
0805 22:37:17.587693 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.587751 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.588512 (+ 761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.588828 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.588832 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.589263 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:17.589605 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.589624 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.590374 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.590375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.591957 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.591960 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.592478 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.592479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.592625 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.593614 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:17.593623 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:17.595599 (+ 1976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:17.597517 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.597523 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.597525 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.597770 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.597938 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.597938 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.597938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.598025 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.598231 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:17.598234 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:17.598354 (+ 120us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.598435 (+ 81us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.598564 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":127,"threads_started":1}
I20260805 22:37:17.599390 21898 heartbeater.cc:347] Connected to a master server at 127.19.77.190:44387
I20260805 22:37:17.599480 21898 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:17.599687 21898 heartbeater.cc:511] Master 127.19.77.190:44387 requested a full tablet report, sending...
I20260805 22:37:17.600400 21547 ts_manager.cc:194] Registered new tserver with Master: 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487)
I20260805 22:37:17.600831 21547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:50499
I20260805 22:37:17.602653 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 21764
I20260805 22:37:17.602771 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:17.602952 19766 external_mini_cluster.cc:1428] Setting key 9aa82d0fe491f3fa616cc77bdb43f663
I20260805 22:37:17.606690 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.600444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:44387 (local address 127.19.77.130:38543)
0805 22:37:17.600601 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.600613 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.600675 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.600817 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.600818 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.601046 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:17.601161 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.601164 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.601858 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.601859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.602395 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.602397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.602763 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.602763 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.602844 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.603390 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:17.603396 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:17.603791 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:17.605599 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.605600 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.605600 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.605783 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.605999 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.606000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.606000 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.606053 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.606411 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:17.606412 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:17.606452 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.606509 (+ 57us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.606597 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260805 22:37:17.606777 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.600530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:38543 (local address 127.19.77.190:44387)
0805 22:37:17.600600 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.600602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.600657 (+ 55us) server_negotiation.cc:407] Connection header received
0805 22:37:17.600733 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.600734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.600744 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.600800 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:17.601230 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.601763 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.602495 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.602685 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.602763 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.603876 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:17.603878 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:17.603878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:17.603886 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:17.605503 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.605857 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.605858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.605859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.605930 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.606117 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.606118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.606118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.606340 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:17.606433 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.606560 (+ 127us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.606643 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:37:17.634215 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:44387
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:34375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:17.719535 21908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:17.719798 21908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:17.719843 21908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:17.721081 21908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:17.721156 21908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:17.721196 21908 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 22:37:17.721246 21908 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:37:17.721287 21908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:17.722867 21908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:34375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.77.190:44387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:17.723213 21908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:17.723483 21908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:17.728534 21916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:17.728523 21914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:17.728947 21908 server_base.cc:1034] running on GCE node
W20260805 22:37:17.728995 21913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:17.729240 21908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:17.729526 21908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:17.738940 21908 hybrid_clock.cc:648] HybridClock initialized: now 1785969437738895 us; error 59 us; skew 500 ppm
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:17.742203 21908 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:37:17.742708 21908 webserver.cc:460] Webserver started at http://127.19.77.131:39797/ using document root <none> and password file <none>
I20260805 22:37:17.742950 21908 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:17.743021 21908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:17.743213 21908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:17.744328 21908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "677a567948364495971f3b53b45a24ba"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "dcc147f2ff147dafc19c0cb066a5d9fa"
server_key_iv: "02e8197408c85866e45e3cd9bdc2ba34"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.744724 21908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "677a567948364495971f3b53b45a24ba"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "dcc147f2ff147dafc19c0cb066a5d9fa"
server_key_iv: "02e8197408c85866e45e3cd9bdc2ba34"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.746132 21908 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:17.746882 21923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.747054 21908 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:17.747188 21908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "677a567948364495971f3b53b45a24ba"
format_stamp: "Formatted at 2026-08-05 22:37:17 on dist-test-slave-chsk"
server_key: "dcc147f2ff147dafc19c0cb066a5d9fa"
server_key_iv: "02e8197408c85866e45e3cd9bdc2ba34"
server_key_version: "encryptionkey@0"
I20260805 22:37:17.747273 21908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:17.757746 21908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:17.760265 21908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:17.760444 21908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:17.761023 21908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:17.761091 21908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.761137 21908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:17.761158 21908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:17.768564 21908 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:42069
I20260805 22:37:17.768878 22041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:42069 every 8 connection(s)
I20260805 22:37:17.769023 21908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:37:17.770028 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 21908
I20260805 22:37:17.770138 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:17.770313 19766 external_mini_cluster.cc:1428] Setting key f6eb6dd8d53e5785ebb6269a4c8ff3d0
I20260805 22:37:17.771538 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.761570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:55419 (local address 127.19.77.190:44387)
0805 22:37:17.761622 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.761625 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.761900 (+ 275us) server_negotiation.cc:407] Connection header received
0805 22:37:17.762411 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.762412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.762428 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.762517 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:17.763413 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.763944 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.764997 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.765246 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.765326 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.768316 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:17.768317 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:17.768318 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:17.768326 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:17.769946 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.770433 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.770434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.770435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.770502 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.770826 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.770827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.770828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.770982 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:17.771049 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.771400 (+ 351us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.771472 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:37:17.771709 21932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.761582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:44387 (local address 127.19.77.131:55419)
0805 22:37:17.761764 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.761806 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.762311 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.762618 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.762623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.763000 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:17.763307 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.763313 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.764048 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.764049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.764895 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.764897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.765338 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.765340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.765473 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.766065 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:17.766081 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:17.768211 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:17.770061 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.770069 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.770071 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.770367 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.770605 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.770606 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.770607 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.770753 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.771061 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:17.771067 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:17.771252 (+ 185us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.771371 (+ 119us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.771502 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":109,"threads_started":1}
I20260805 22:37:17.772228 22042 heartbeater.cc:347] Connected to a master server at 127.19.77.190:44387
I20260805 22:37:17.772317 22042 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:17.772503 22042 heartbeater.cc:511] Master 127.19.77.190:44387 requested a full tablet report, sending...
I20260805 22:37:17.772904 21546 ts_manager.cc:194] Registered new tserver with Master: 677a567948364495971f3b53b45a24ba (127.19.77.131:42069)
I20260805 22:37:17.773346 21546 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:55419
I20260805 22:37:17.778537 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.773389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:37897 (local address 127.19.77.190:44387)
0805 22:37:17.773434 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.773436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.773625 (+ 189us) server_negotiation.cc:407] Connection header received
0805 22:37:17.773649 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.773649 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.773661 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.773708 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:17.774086 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.774537 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.775342 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.775520 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.775584 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.776511 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:17.776512 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:17.776512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:17.776517 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:17.777626 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.777921 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.777922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.777922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.777972 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.778145 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.778145 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.778145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.778237 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:17.778286 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.778407 (+ 121us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.778466 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:37:17.778558 22048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.773293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:44387 (local address 127.19.77.131:37897)
0805 22:37:17.773517 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.773533 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.773587 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.773738 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.773739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.773940 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:17.774007 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.774009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.774700 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.774701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.775274 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.775276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.775588 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.775588 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.775645 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.776146 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:17.776151 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:17.776438 (+ 287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:17.777694 (+ 1256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.777695 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.777695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.777854 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.778028 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.778028 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.778028 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.778080 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.778300 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:17.778301 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:17.778338 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.778393 (+ 55us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.778471 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260805 22:37:17.782123 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:17.806838 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.799124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38864 (local address 127.19.77.190:44387)
0805 22:37:17.799204 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.799206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.799216 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:17.799243 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.799244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.799262 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.799328 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:17.800024 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.800625 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.801331 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.801523 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.801580 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.804022 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:17.804023 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:17.804023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:17.804032 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:17.805541 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.805889 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.805890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.805891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.805948 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.806199 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.806199 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.806200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.806313 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:17.806392 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.806579 (+ 187us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.806691 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260805 22:37:17.808676 21546 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38864:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:17.810508 21546 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:17.818156 22059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.813349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:39487 (local address 127.0.0.1:43678)
0805 22:37:17.813693 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.813705 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.813772 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.814097 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.814098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.814101 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:17.814231 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.814232 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.815675 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.815677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.816948 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.816952 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.817873 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.817874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.817944 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.817958 (+ 14us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.818023 (+ 65us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.818071 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":217,"thread_start_us":78,"threads_started":1}
I20260805 22:37:17.818213 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.813472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43678 (local address 127.19.77.130:39487)
0805 22:37:17.813720 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.813724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.813819 (+ 95us) server_negotiation.cc:407] Connection header received
0805 22:37:17.813865 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.813867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.813886 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.813960 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:17.814324 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.815541 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.817056 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.817765 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.817851 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.817913 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.818058 (+ 145us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.818103 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":122,"threads_started":1}
I20260805 22:37:17.819377 21832 tablet_service.cc:1467] Processing CreateTablet for tablet 23b56d69806a45aba8ac2e0c05d3cb07 (DEFAULT_TABLE table=test-table [id=3b0decce60ca4386aaf680c2a1732f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:17.819728 22062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.813117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:42069 (local address 127.0.0.1:60934)
0805 22:37:17.813693 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.813705 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.813772 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.814093 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.814096 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.814099 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:17.814219 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.814221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.815446 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.815449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.817269 (+ 1820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.817273 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.819280 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.819282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.819483 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.819500 (+ 17us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.819583 (+ 83us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.819646 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":268,"thread_start_us":99,"threads_started":1}
I20260805 22:37:17.819777 22061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.813270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60934 (local address 127.19.77.131:42069)
0805 22:37:17.813475 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.813480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.813768 (+ 288us) server_negotiation.cc:407] Connection header received
0805 22:37:17.813892 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.813895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.813912 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.813989 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:17.814307 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.815081 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.817388 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.818192 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.818269 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.818327 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.819618 (+ 1291us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.819668 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":95,"threads_started":1}
I20260805 22:37:17.819846 21832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23b56d69806a45aba8ac2e0c05d3cb07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:17.820230 22060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.813089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:44965 (local address 127.0.0.1:57196)
0805 22:37:17.813273 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.813319 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.813397 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.814097 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.814098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.814103 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:17.814230 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.814232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.815662 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.815663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.817269 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.817274 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.819302 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.819303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.819483 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.819500 (+ 17us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.819583 (+ 83us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.820161 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":125,"thread_start_us":74,"threads_started":1}
I20260805 22:37:17.820290 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.813517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57196 (local address 127.19.77.129:44965)
0805 22:37:17.813714 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.813719 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.813730 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:17.813969 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.813971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.813987 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.814344 (+ 357us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:17.814413 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.815563 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.818375 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.819086 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.819293 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.819359 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.820101 (+ 742us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.820163 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":95,"threads_started":1}
I20260805 22:37:17.820505 21975 tablet_service.cc:1467] Processing CreateTablet for tablet 23b56d69806a45aba8ac2e0c05d3cb07 (DEFAULT_TABLE table=test-table [id=3b0decce60ca4386aaf680c2a1732f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:17.820860 21975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23b56d69806a45aba8ac2e0c05d3cb07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:17.823066 22066 tablet_bootstrap.cc:492] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: Bootstrap starting.
I20260805 22:37:17.823590 22067 tablet_bootstrap.cc:492] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: Bootstrap starting.
I20260805 22:37:17.823844 22066 tablet_bootstrap.cc:654] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:17.823709 21687 tablet_service.cc:1467] Processing CreateTablet for tablet 23b56d69806a45aba8ac2e0c05d3cb07 (DEFAULT_TABLE table=test-table [id=3b0decce60ca4386aaf680c2a1732f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:17.824087 21687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23b56d69806a45aba8ac2e0c05d3cb07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:17.824219 22066 log.cc:824] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:17.824560 22067 tablet_bootstrap.cc:654] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:17.824903 22067 log.cc:824] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:17.825066 22066 tablet_bootstrap.cc:492] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: No bootstrap required, opened a new log
I20260805 22:37:17.825156 22066 ts_tablet_manager.cc:1397] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:17.825664 22067 tablet_bootstrap.cc:492] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: No bootstrap required, opened a new log
I20260805 22:37:17.825748 22067 ts_tablet_manager.cc:1397] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:37:17.827117 22067 raft_consensus.cc:348] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } }
I20260805 22:37:17.827381 22067 raft_consensus.cc:374] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:17.827432 22067 raft_consensus.cc:729] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677a567948364495971f3b53b45a24ba, State: Initialized, Role: FOLLOWER
I20260805 22:37:17.827575 22067 consensus_queue.cc:260] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } }
I20260805 22:37:17.827895 22067 ts_tablet_manager.cc:1428] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260805 22:37:17.828039 22042 heartbeater.cc:503] Master 127.19.77.190:44387 was elected leader, sending a full tablet report...
I20260805 22:37:17.828049 22066 raft_consensus.cc:348] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } }
I20260805 22:37:17.828246 22066 raft_consensus.cc:374] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:17.828296 22066 raft_consensus.cc:729] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eeb459c63f045a9b1179d6c272c32d1, State: Initialized, Role: FOLLOWER
I20260805 22:37:17.828416 22066 consensus_queue.cc:260] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } }
I20260805 22:37:17.828760 22066 ts_tablet_manager.cc:1428] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260805 22:37:17.828790 21898 heartbeater.cc:503] Master 127.19.77.190:44387 was elected leader, sending a full tablet report...
I20260805 22:37:17.829640 22072 tablet_bootstrap.cc:492] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: Bootstrap starting.
I20260805 22:37:17.830417 22072 tablet_bootstrap.cc:654] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:17.830760 22072 log.cc:824] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:17.831904 22072 tablet_bootstrap.cc:492] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: No bootstrap required, opened a new log
I20260805 22:37:17.831984 22072 ts_tablet_manager.cc:1397] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:17.833647 22072 raft_consensus.cc:348] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } }
I20260805 22:37:17.833792 22072 raft_consensus.cc:374] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:17.833813 22072 raft_consensus.cc:729] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac6bcdf229473d8c75819a250d3b61, State: Initialized, Role: FOLLOWER
I20260805 22:37:17.833948 22072 consensus_queue.cc:260] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } }
I20260805 22:37:17.834228 22072 ts_tablet_manager.cc:1428] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:37:17.834359 21755 heartbeater.cc:503] Master 127.19.77.190:44387 was elected leader, sending a full tablet report...
I20260805 22:37:17.835824 22070 raft_consensus.cc:482] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:17.835942 22070 raft_consensus.cc:504] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } }
I20260805 22:37:17.836300 22070 leader_election.cc:288] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487), f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965)
I20260805 22:37:17.840481 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.836684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:41617 (local address 127.19.77.129:44965)
0805 22:37:17.836746 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.836748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.836831 (+ 83us) server_negotiation.cc:407] Connection header received
0805 22:37:17.836877 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.836878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.836886 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.836932 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:17.837058 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.837792 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.839408 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.840033 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.840101 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.840108 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.840361 (+ 253us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.840407 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:37:17.840495 21932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.836460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:39487 (local address 127.19.77.131:49859)
0805 22:37:17.836517 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.836528 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.836573 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.836825 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.836826 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.836827 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:17.836906 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.836907 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.837907 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.837909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.839237 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.839241 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.840171 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.840172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.840280 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.840283 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.840342 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.840397 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":118}
I20260805 22:37:17.840502 22075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.836518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:44965 (local address 127.19.77.131:41617)
0805 22:37:17.836749 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.836757 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.836827 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.836935 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.836935 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.836936 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:17.837002 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.837004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.837907 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.837909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.839237 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.839241 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.840171 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.840172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.840261 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.840266 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.840342 (+ 76us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.840397 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":14,"thread_start_us":109,"threads_started":1}
I20260805 22:37:17.840879 21707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23b56d69806a45aba8ac2e0c05d3cb07" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac6bcdf229473d8c75819a250d3b61" is_pre_election: true
I20260805 22:37:17.840528 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.836547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:49859 (local address 127.19.77.130:39487)
0805 22:37:17.836668 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.836671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.836680 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:17.836725 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.836726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.836736 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.836821 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:17.836981 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.837793 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.839418 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.840001 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.840093 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.840103 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.840361 (+ 258us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.840409 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260805 22:37:17.841091 21707 raft_consensus.cc:2454] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 0.
I20260805 22:37:17.841456 21926 leader_election.cc:302] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 677a567948364495971f3b53b45a24ba, f5ac6bcdf229473d8c75819a250d3b61; no voters:
I20260805 22:37:17.841535 21852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23b56d69806a45aba8ac2e0c05d3cb07" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eeb459c63f045a9b1179d6c272c32d1" is_pre_election: true
I20260805 22:37:17.841614 22070 raft_consensus.cc:2781] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:17.841677 22070 raft_consensus.cc:482] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:17.841686 21852 raft_consensus.cc:2454] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 0.
I20260805 22:37:17.841711 22070 raft_consensus.cc:3037] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:17.842463 22070 raft_consensus.cc:504] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } }
I20260805 22:37:17.842622 22070 leader_election.cc:288] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 election: Requested vote from peers 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487), f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965)
I20260805 22:37:17.842797 21852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23b56d69806a45aba8ac2e0c05d3cb07" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eeb459c63f045a9b1179d6c272c32d1"
I20260805 22:37:17.842808 21707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23b56d69806a45aba8ac2e0c05d3cb07" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac6bcdf229473d8c75819a250d3b61"
I20260805 22:37:17.842885 21707 raft_consensus.cc:3037] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:17.842885 21852 raft_consensus.cc:3037] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:17.844173 21852 raft_consensus.cc:2454] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 1.
I20260805 22:37:17.844173 21707 raft_consensus.cc:2454] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 1.
I20260805 22:37:17.844554 21924 leader_election.cc:302] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eeb459c63f045a9b1179d6c272c32d1, 677a567948364495971f3b53b45a24ba; no voters:
I20260805 22:37:17.844760 22070 raft_consensus.cc:2781] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:17.845052 22070 raft_consensus.cc:686] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 1 LEADER]: Becoming Leader. State: Replica: 677a567948364495971f3b53b45a24ba, State: Running, Role: LEADER
I20260805 22:37:17.845162 22070 consensus_queue.cc:237] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } }
W20260805 22:37:17.846254 21899 tablet.cc:2369] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:37:17.846205 21546 catalog_manager.cc:5495] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 677a567948364495971f3b53b45a24ba (127.19.77.131). New cstate: current_term: 1 leader_uuid: "677a567948364495971f3b53b45a24ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } health_report { overall_health: UNKNOWN } } }
Aug 05 22:37:17 dist-test-slave-chsk krb5kdc[21500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:17.879765 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.872145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38874 (local address 127.19.77.190:44387)
0805 22:37:17.872215 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.872217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.872341 (+ 124us) server_negotiation.cc:407] Connection header received
0805 22:37:17.872430 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.872430 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.872444 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.872492 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:17.872979 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.873513 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.874271 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.874457 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.874549 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.876940 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:17.876942 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:17.876943 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:17.876949 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:17.878345 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.878752 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.878753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.878753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.878814 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:17.879016 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:17.879017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:17.879017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:17.879202 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:17.879286 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.879460 (+ 174us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.879617 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":37}
I20260805 22:37:17.879832 22083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.872094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:44387 (local address 127.0.0.1:38874)
0805 22:37:17.872256 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.872274 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.872364 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.872497 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.872498 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.872837 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:17.872883 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.872887 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.873603 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.873604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.874180 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.874182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.874570 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.874570 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.874633 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.875361 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:17.875366 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:17.876812 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:17.878440 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.878450 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.878453 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.878670 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.878884 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:17.878885 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:17.878886 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:17.878949 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:17.879287 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:17.879296 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:17.879343 (+ 47us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.879422 (+ 79us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.879698 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":112,"thread_start_us":96,"threads_started":1}
I20260805 22:37:17.882174 21546 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:38874:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 22:37:17.882400 21546 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:17.884035 21687 tablet_service.cc:1467] Processing CreateTablet for tablet 454033926641469f9131394a5ff11d01 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5a42229e766745e6a4f0db36097bbf05]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:37:17.884030 21832 tablet_service.cc:1467] Processing CreateTablet for tablet 454033926641469f9131394a5ff11d01 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5a42229e766745e6a4f0db36097bbf05]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:37:17.884228 21687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454033926641469f9131394a5ff11d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:17.884228 21832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454033926641469f9131394a5ff11d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:17.884274 21975 tablet_service.cc:1467] Processing CreateTablet for tablet 454033926641469f9131394a5ff11d01 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5a42229e766745e6a4f0db36097bbf05]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:37:17.884462 21975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454033926641469f9131394a5ff11d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:17.885733 22067 tablet_bootstrap.cc:492] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: Bootstrap starting.
I20260805 22:37:17.885887 22072 tablet_bootstrap.cc:492] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: Bootstrap starting.
I20260805 22:37:17.886202 22067 tablet_bootstrap.cc:654] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:17.886559 22072 tablet_bootstrap.cc:654] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:17.886897 22067 tablet_bootstrap.cc:492] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: No bootstrap required, opened a new log
I20260805 22:37:17.886977 22067 ts_tablet_manager.cc:1397] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:17.886982 22066 tablet_bootstrap.cc:492] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: Bootstrap starting.
I20260805 22:37:17.887173 22067 raft_consensus.cc:348] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:17.887270 22067 raft_consensus.cc:374] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:17.887286 22067 raft_consensus.cc:729] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677a567948364495971f3b53b45a24ba, State: Initialized, Role: FOLLOWER
I20260805 22:37:17.887346 22067 consensus_queue.cc:260] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:17.887437 22067 ts_tablet_manager.cc:1428] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260805 22:37:17.887558 22070 tablet_replica.cc:439] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } }
I20260805 22:37:17.887622 22070 tablet_replica.cc:442] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:17.887744 22066 tablet_bootstrap.cc:654] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:17.888335 22072 tablet_bootstrap.cc:492] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: No bootstrap required, opened a new log
I20260805 22:37:17.888394 22072 ts_tablet_manager.cc:1397] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260805 22:37:17.888489 22066 tablet_bootstrap.cc:492] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: No bootstrap required, opened a new log
I20260805 22:37:17.888545 22066 ts_tablet_manager.cc:1397] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:17.888553 22072 raft_consensus.cc:348] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:17.888628 22072 raft_consensus.cc:374] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:17.888674 22072 raft_consensus.cc:729] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac6bcdf229473d8c75819a250d3b61, State: Initialized, Role: FOLLOWER
I20260805 22:37:17.888728 22072 consensus_queue.cc:260] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:17.888717 22066 raft_consensus.cc:348] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:17.888799 22066 raft_consensus.cc:374] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:17.888832 22066 raft_consensus.cc:729] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eeb459c63f045a9b1179d6c272c32d1, State: Initialized, Role: FOLLOWER
I20260805 22:37:17.888841 22072 ts_tablet_manager.cc:1428] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.888882 22066 consensus_queue.cc:260] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:17.888917 22074 tablet_replica.cc:439] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } }
I20260805 22:37:17.888983 22066 ts_tablet_manager.cc:1428] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:17.889012 22074 tablet_replica.cc:442] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:17.889076 22071 tablet_replica.cc:439] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } }
I20260805 22:37:17.889171 22071 tablet_replica.cc:442] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: This TxnStatusTablet replica's current role is: FOLLOWER
W20260805 22:37:17.928771 21756 tablet.cc:2369] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:37:17.943296 22071 raft_consensus.cc:482] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:17.943454 22071 raft_consensus.cc:504] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:17.943886 22071 leader_election.cc:288] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965), 677a567948364495971f3b53b45a24ba (127.19.77.131:42069)
I20260805 22:37:17.948083 22061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.944294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:57825 (local address 127.19.77.131:42069)
0805 22:37:17.944354 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.944356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.944368 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:37:17.944410 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.944411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.944424 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.944489 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:17.944688 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.945474 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.946985 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.947642 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.947723 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.947733 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.947949 (+ 216us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.948003 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260805 22:37:17.948083 21789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.944159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:42069 (local address 127.19.77.130:57825)
0805 22:37:17.944258 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.944269 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.944342 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.944523 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.944524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.944525 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:17.944610 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.944612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.945563 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.945564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.946837 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.946840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.947751 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.947752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.947847 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.947870 (+ 23us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.947931 (+ 61us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.947981 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":8}
I20260805 22:37:17.948134 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.944399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:52653 (local address 127.19.77.129:44965)
0805 22:37:17.944454 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.944456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.944625 (+ 169us) server_negotiation.cc:407] Connection header received
0805 22:37:17.944680 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.944681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.944692 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.944753 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:17.944891 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.945588 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.946985 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.947624 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.947724 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.947733 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.948008 (+ 275us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.948061 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:37:17.948426 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.944331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:44965 (local address 127.19.77.130:52653)
0805 22:37:17.944544 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.944555 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.944613 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.944768 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.944768 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.944770 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:17.944821 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.944822 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.945689 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.945690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.946837 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.946840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.947822 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.947823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.947906 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.947911 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.948253 (+ 342us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.948314 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":4,"thread_start_us":134,"threads_started":1}
I20260805 22:37:17.948467 21995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454033926641469f9131394a5ff11d01" candidate_uuid: "4eeb459c63f045a9b1179d6c272c32d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "677a567948364495971f3b53b45a24ba" is_pre_election: true
I20260805 22:37:17.948638 21995 raft_consensus.cc:2454] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eeb459c63f045a9b1179d6c272c32d1 in term 0.
I20260805 22:37:17.948727 21707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454033926641469f9131394a5ff11d01" candidate_uuid: "4eeb459c63f045a9b1179d6c272c32d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac6bcdf229473d8c75819a250d3b61" is_pre_election: true
I20260805 22:37:17.948834 21707 raft_consensus.cc:2454] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eeb459c63f045a9b1179d6c272c32d1 in term 0.
I20260805 22:37:17.948905 21780 leader_election.cc:302] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eeb459c63f045a9b1179d6c272c32d1, 677a567948364495971f3b53b45a24ba; no voters:
I20260805 22:37:17.949100 22071 raft_consensus.cc:2781] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:17.949162 22071 raft_consensus.cc:482] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:17.949198 22071 raft_consensus.cc:3037] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:17.950070 22071 raft_consensus.cc:504] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:17.950238 22071 leader_election.cc:288] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [CANDIDATE]: Term 1 election: Requested vote from peers f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965), 677a567948364495971f3b53b45a24ba (127.19.77.131:42069)
I20260805 22:37:17.950419 21995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454033926641469f9131394a5ff11d01" candidate_uuid: "4eeb459c63f045a9b1179d6c272c32d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "677a567948364495971f3b53b45a24ba"
I20260805 22:37:17.950419 21707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454033926641469f9131394a5ff11d01" candidate_uuid: "4eeb459c63f045a9b1179d6c272c32d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac6bcdf229473d8c75819a250d3b61"
I20260805 22:37:17.950510 21995 raft_consensus.cc:3037] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:17.950510 21707 raft_consensus.cc:3037] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:17.951463 21707 raft_consensus.cc:2454] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eeb459c63f045a9b1179d6c272c32d1 in term 1.
I20260805 22:37:17.951463 21995 raft_consensus.cc:2454] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eeb459c63f045a9b1179d6c272c32d1 in term 1.
I20260805 22:37:17.951718 21782 leader_election.cc:302] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eeb459c63f045a9b1179d6c272c32d1, f5ac6bcdf229473d8c75819a250d3b61; no voters:
I20260805 22:37:17.951818 22071 raft_consensus.cc:2781] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:17.952042 22071 raft_consensus.cc:686] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4eeb459c63f045a9b1179d6c272c32d1, State: Running, Role: LEADER
I20260805 22:37:17.952168 22071 consensus_queue.cc:237] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:17.952631 22088 tablet_replica.cc:439] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: TxnStatusTablet state changed. Reason: New leader 4eeb459c63f045a9b1179d6c272c32d1. Latest consensus state: current_term: 1 leader_uuid: "4eeb459c63f045a9b1179d6c272c32d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } }
I20260805 22:37:17.952725 22088 tablet_replica.cc:442] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:37:17.952919 22090 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 22:37:17.953051 22090 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 22:37:17.953032 21547 catalog_manager.cc:5495] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130). New cstate: current_term: 1 leader_uuid: "4eeb459c63f045a9b1179d6c272c32d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } health_report { overall_health: UNKNOWN } } }
I20260805 22:37:17.968856 22083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.965968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:39487 (local address 127.0.0.1:43694)
0805 22:37:17.966116 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.966131 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.966221 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.966469 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.966470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.966471 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:17.966528 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.966531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.967286 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.967287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.967885 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.967887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.968276 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.968277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.968347 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.968369 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:17.968662 (+ 293us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:17.968672 (+ 10us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.968718 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.968771 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260805 22:37:17.968851 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.966040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43694 (local address 127.19.77.130:39487)
0805 22:37:17.966108 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.966111 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.966189 (+ 78us) server_negotiation.cc:407] Connection header received
0805 22:37:17.966330 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.966331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.966363 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.966460 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:17.966632 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.967194 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.967972 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.968186 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.968274 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.968476 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:17.968587 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:17.968673 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.968721 (+ 48us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.968744 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:37:17.971316 21707 raft_consensus.cc:1261] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Refusing update from remote peer 4eeb459c63f045a9b1179d6c272c32d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:17.971316 21995 raft_consensus.cc:1261] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Refusing update from remote peer 4eeb459c63f045a9b1179d6c272c32d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:17.971670 22088 consensus_queue.cc:1035] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:17.971812 22071 consensus_queue.cc:1035] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:17.973078 22070 tablet_replica.cc:439] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: TxnStatusTablet state changed. Reason: New leader 4eeb459c63f045a9b1179d6c272c32d1. Latest consensus state: current_term: 1 leader_uuid: "4eeb459c63f045a9b1179d6c272c32d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } }
I20260805 22:37:17.973120 22074 tablet_replica.cc:439] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: TxnStatusTablet state changed. Reason: New leader 4eeb459c63f045a9b1179d6c272c32d1. Latest consensus state: current_term: 1 leader_uuid: "4eeb459c63f045a9b1179d6c272c32d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } }
I20260805 22:37:17.973184 22070 tablet_replica.cc:442] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:17.973201 22074 tablet_replica.cc:442] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:17.974824 22088 tablet_replica.cc:439] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4eeb459c63f045a9b1179d6c272c32d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } }
I20260805 22:37:17.974857 22074 tablet_replica.cc:439] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4eeb459c63f045a9b1179d6c272c32d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } }
I20260805 22:37:17.974929 22074 tablet_replica.cc:442] T 454033926641469f9131394a5ff11d01 P f5ac6bcdf229473d8c75819a250d3b61: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:17.974929 22088 tablet_replica.cc:442] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:37:17.976507 22071 tablet_replica.cc:439] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4eeb459c63f045a9b1179d6c272c32d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } }
I20260805 22:37:17.976619 22071 tablet_replica.cc:442] T 454033926641469f9131394a5ff11d01 P 4eeb459c63f045a9b1179d6c272c32d1: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:37:17.977202 22070 tablet_replica.cc:439] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4eeb459c63f045a9b1179d6c272c32d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } } }
I20260805 22:37:17.977298 22070 tablet_replica.cc:442] T 454033926641469f9131394a5ff11d01 P 677a567948364495971f3b53b45a24ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:17.980904 22061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.977960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60950 (local address 127.19.77.131:42069)
0805 22:37:17.978003 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.978005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.978015 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:17.978057 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.978058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.978073 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.978133 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:17.978330 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.978852 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.980070 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.980274 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.980342 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.980531 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:17.980648 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:17.980714 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.980789 (+ 75us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.980810 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:37:17.987298 22048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.984101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:39487 (local address 127.19.77.131:50839)
0805 22:37:17.984185 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.984199 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.984250 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.984395 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.984396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.984397 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:17.984464 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.984465 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.985101 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.985102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.986018 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.986021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.986618 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.986619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:17.986703 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.986726 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:17.987045 (+ 319us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:17.987047 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:37:17.987108 (+ 61us) client_negotiation.cc:240] Negotiation successful
0805 22:37:17.987202 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260805 22:37:17.987440 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.984210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:50839 (local address 127.19.77.130:39487)
0805 22:37:17.984272 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.984274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.984285 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:17.984311 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.984311 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.984328 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.984377 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:17.984530 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.985022 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.986207 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:17.986476 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:17.986599 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:17.986911 (+ 312us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:17.986962 (+ 51us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:17.987028 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:17.987233 (+ 205us) server_negotiation.cc:299] Negotiation successful
0805 22:37:17.987331 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:37:17.990116 21707 raft_consensus.cc:1261] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Refusing update from remote peer 677a567948364495971f3b53b45a24ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:17.990178 21852 raft_consensus.cc:1261] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Refusing update from remote peer 677a567948364495971f3b53b45a24ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:17.990453 22076 consensus_queue.cc:1035] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:17.990651 22070 consensus_queue.cc:1035] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:17.992779 22093 mvcc.cc:205] Tried to move back new op lower bound from 7315330818005348352 to 7315330817414639616. Current Snapshot: MvccSnapshot[applied={T|T < 7315330818005348352}]
I20260805 22:37:17.997018 22094 mvcc.cc:205] Tried to move back new op lower bound from 7315330818005348352 to 7315330817414639616. Current Snapshot: MvccSnapshot[applied={T|T < 7315330818005348352}]
I20260805 22:37:18.002031 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.998926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:42069 (local address 127.19.77.130:60713)
0805 22:37:17.999049 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:17.999061 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:17.999110 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:17.999380 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:17.999381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:17.999382 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:17.999454 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:17.999456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.000439 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.000441 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:18.001075 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:18.001077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.001575 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.001576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:18.001647 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.001671 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:18.001848 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:18.001851 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:18.001908 (+ 57us) client_negotiation.cc:240] Negotiation successful
0805 22:37:18.001963 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260805 22:37:18.002065 22061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:17.999224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:60713 (local address 127.19.77.131:42069)
0805 22:37:17.999269 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:17.999271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:17.999279 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:37:17.999301 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:17.999301 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:17.999312 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:17.999366 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:17.999538 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.000290 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.001167 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.001469 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.001537 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.001762 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:18.001797 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:18.001846 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:18.001916 (+ 70us) server_negotiation.cc:299] Negotiation successful
0805 22:37:18.001956 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:37:18.012902 21545 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:18.013046 21545 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:18.013967 21545 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5: Sending DeleteTablet for 3 replicas of tablet 23b56d69806a45aba8ac2e0c05d3cb07
I20260805 22:37:18.014333 21975 tablet_service.cc:1514] Processing DeleteTablet for tablet 23b56d69806a45aba8ac2e0c05d3cb07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:18 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:60934
I20260805 22:37:18.014335 21687 tablet_service.cc:1514] Processing DeleteTablet for tablet 23b56d69806a45aba8ac2e0c05d3cb07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:18 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:57196
I20260805 22:37:18.014757 21832 tablet_service.cc:1514] Processing DeleteTablet for tablet 23b56d69806a45aba8ac2e0c05d3cb07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:18 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:43678
I20260805 22:37:18.015072 22114 tablet_replica.cc:330] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: stopping tablet replica
I20260805 22:37:18.015031 21545 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38864:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:18.015226 21545 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:18.015447 22114 raft_consensus.cc:2229] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:18.015596 22114 raft_consensus.cc:2258] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:18.016384 21687 tablet_service.cc:1467] Processing CreateTablet for tablet 1d6bbbf1868b496fb507e917bbdf1e3d (DEFAULT_TABLE table=test-table [id=0891ac13329e4bcebad61ea807586637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:18.016494 21975 tablet_service.cc:1467] Processing CreateTablet for tablet 1d6bbbf1868b496fb507e917bbdf1e3d (DEFAULT_TABLE table=test-table [id=0891ac13329e4bcebad61ea807586637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:18.016543 21687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d6bbbf1868b496fb507e917bbdf1e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:18.016613 21975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d6bbbf1868b496fb507e917bbdf1e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:18.016784 22114 ts_tablet_manager.cc:1905] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:18.017926 22072 tablet_bootstrap.cc:492] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61: Bootstrap starting.
I20260805 22:37:18.017949 22067 tablet_bootstrap.cc:492] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba: Bootstrap starting.
I20260805 22:37:18.018071 21832 tablet_service.cc:1467] Processing CreateTablet for tablet 1d6bbbf1868b496fb507e917bbdf1e3d (DEFAULT_TABLE table=test-table [id=0891ac13329e4bcebad61ea807586637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:18.018226 21832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d6bbbf1868b496fb507e917bbdf1e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:18.018362 22067 tablet_bootstrap.cc:654] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:18.018375 22072 tablet_bootstrap.cc:654] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:18.019157 22114 ts_tablet_manager.cc:1918] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:18.019301 22114 log.cc:1196] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/23b56d69806a45aba8ac2e0c05d3cb07
I20260805 22:37:18.019810 22066 tablet_bootstrap.cc:492] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1: Bootstrap starting.
I20260805 22:37:18.020218 22114 ts_tablet_manager.cc:1939] T 23b56d69806a45aba8ac2e0c05d3cb07 P f5ac6bcdf229473d8c75819a250d3b61: Deleting consensus metadata
I20260805 22:37:18.020226 22066 tablet_bootstrap.cc:654] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:18.020661 22115 tablet_replica.cc:330] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: stopping tablet replica
I20260805 22:37:18.020710 21533 catalog_manager.cc:4841] TS f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965): tablet 23b56d69806a45aba8ac2e0c05d3cb07 (table test-table [id=3b0decce60ca4386aaf680c2a1732f72]) successfully deleted
I20260805 22:37:18.020790 22115 raft_consensus.cc:2229] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:18.020845 22115 raft_consensus.cc:2258] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:18.021291 22115 ts_tablet_manager.cc:1905] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:18.022948 22115 ts_tablet_manager.cc:1918] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:18.023031 22115 log.cc:1196] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/23b56d69806a45aba8ac2e0c05d3cb07
I20260805 22:37:18.023340 22115 ts_tablet_manager.cc:1939] T 23b56d69806a45aba8ac2e0c05d3cb07 P 4eeb459c63f045a9b1179d6c272c32d1: Deleting consensus metadata
I20260805 22:37:18.023656 22067 tablet_bootstrap.cc:492] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba: No bootstrap required, opened a new log
I20260805 22:37:18.023717 22067 ts_tablet_manager.cc:1397] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260805 22:37:18.023764 21531 catalog_manager.cc:4841] TS 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487): tablet 23b56d69806a45aba8ac2e0c05d3cb07 (table test-table [id=3b0decce60ca4386aaf680c2a1732f72]) successfully deleted
I20260805 22:37:18.023895 22067 raft_consensus.cc:348] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:18.023998 22067 raft_consensus.cc:374] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:18.024034 22067 raft_consensus.cc:729] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677a567948364495971f3b53b45a24ba, State: Initialized, Role: FOLLOWER
I20260805 22:37:18.024088 22067 consensus_queue.cc:260] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:18.024187 22067 ts_tablet_manager.cc:1428] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:18.024408 22066 tablet_bootstrap.cc:492] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1: No bootstrap required, opened a new log
I20260805 22:37:18.024451 22066 ts_tablet_manager.cc:1397] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260805 22:37:18.024552 22066 raft_consensus.cc:348] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:18.024636 22066 raft_consensus.cc:374] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:18.024660 22066 raft_consensus.cc:729] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eeb459c63f045a9b1179d6c272c32d1, State: Initialized, Role: FOLLOWER
I20260805 22:37:18.024709 22066 consensus_queue.cc:260] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:18.024832 22066 ts_tablet_manager.cc:1428] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:18.027297 22113 tablet_replica.cc:330] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: stopping tablet replica
I20260805 22:37:18.027446 22113 raft_consensus.cc:2229] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:18.027577 22113 raft_consensus.cc:2258] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:18.027618 22072 tablet_bootstrap.cc:492] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61: No bootstrap required, opened a new log
I20260805 22:37:18.027676 22072 ts_tablet_manager.cc:1397] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20260805 22:37:18.027846 22072 raft_consensus.cc:348] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:18.027944 22072 raft_consensus.cc:374] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:18.027973 22072 raft_consensus.cc:729] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac6bcdf229473d8c75819a250d3b61, State: Initialized, Role: FOLLOWER
I20260805 22:37:18.028017 22072 consensus_queue.cc:260] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:18.028085 22113 ts_tablet_manager.cc:1905] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:18.028112 22072 ts_tablet_manager.cc:1428] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:18.029927 22113 ts_tablet_manager.cc:1918] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:18.030005 22113 log.cc:1196] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/23b56d69806a45aba8ac2e0c05d3cb07
I20260805 22:37:18.030264 22113 ts_tablet_manager.cc:1939] T 23b56d69806a45aba8ac2e0c05d3cb07 P 677a567948364495971f3b53b45a24ba: Deleting consensus metadata
I20260805 22:37:18.030795 21531 catalog_manager.cc:4841] TS 677a567948364495971f3b53b45a24ba (127.19.77.131:42069): tablet 23b56d69806a45aba8ac2e0c05d3cb07 (table test-table [id=3b0decce60ca4386aaf680c2a1732f72]) successfully deleted
I20260805 22:37:18.048533 22074 raft_consensus.cc:482] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:18.048667 22074 raft_consensus.cc:504] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:18.049022 22074 leader_election.cc:288] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487), 677a567948364495971f3b53b45a24ba (127.19.77.131:42069)
I20260805 22:37:18.053783 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:18.049322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:36763 (local address 127.19.77.130:39487)
0805 22:37:18.049373 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:18.049376 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:18.049627 (+ 251us) server_negotiation.cc:407] Connection header received
0805 22:37:18.049784 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:18.049785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:18.049795 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:18.049828 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:18.050082 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.050875 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.052544 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.053104 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.053160 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.053171 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:18.053662 (+ 491us) server_negotiation.cc:299] Negotiation successful
0805 22:37:18.053705 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:37:18.053869 22061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:18.049605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:59409 (local address 127.19.77.131:42069)
0805 22:37:18.049650 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:18.049652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:18.049758 (+ 106us) server_negotiation.cc:407] Connection header received
0805 22:37:18.049912 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:18.049913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:18.049924 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:18.049957 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:18.050271 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.051017 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.052918 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.053493 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.053539 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.053547 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:18.053755 (+ 208us) server_negotiation.cc:299] Negotiation successful
0805 22:37:18.053793 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:37:18.054145 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:18.049423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:42069 (local address 127.19.77.129:59409)
0805 22:37:18.049701 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:18.049710 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:18.049782 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:18.050087 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:18.050088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:18.050089 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:18.050160 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:18.050162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.051422 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.051422 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:18.052821 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:18.052823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.053609 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.053610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:18.053675 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.053679 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:18.053992 (+ 313us) client_negotiation.cc:240] Negotiation successful
0805 22:37:18.054038 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":64,"threads_started":1}
I20260805 22:37:18.054376 21995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d6bbbf1868b496fb507e917bbdf1e3d" candidate_uuid: "f5ac6bcdf229473d8c75819a250d3b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "677a567948364495971f3b53b45a24ba" is_pre_election: true
I20260805 22:37:18.054481 21995 raft_consensus.cc:2454] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5ac6bcdf229473d8c75819a250d3b61 in term 0.
I20260805 22:37:18.054710 22119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:18.049240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:39487 (local address 127.19.77.129:36763)
0805 22:37:18.049544 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:18.049557 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:18.049660 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:18.049904 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:18.049905 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:18.049907 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:18.049983 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:18.049985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.051022 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.051023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:18.052422 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:18.052426 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.053473 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.053474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:18.053566 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.053570 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:18.054461 (+ 891us) client_negotiation.cc:240] Negotiation successful
0805 22:37:18.054611 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":1,"thread_start_us":71,"threads_started":1}
I20260805 22:37:18.054673 21636 leader_election.cc:302] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 677a567948364495971f3b53b45a24ba, f5ac6bcdf229473d8c75819a250d3b61; no voters:
I20260805 22:37:18.055086 22074 raft_consensus.cc:2781] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:18.055199 22074 raft_consensus.cc:482] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:18.055230 22074 raft_consensus.cc:3037] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:18.055225 21852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d6bbbf1868b496fb507e917bbdf1e3d" candidate_uuid: "f5ac6bcdf229473d8c75819a250d3b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eeb459c63f045a9b1179d6c272c32d1" is_pre_election: true
I20260805 22:37:18.055310 21852 raft_consensus.cc:2454] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5ac6bcdf229473d8c75819a250d3b61 in term 0.
I20260805 22:37:18.056202 22074 raft_consensus.cc:504] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:18.056350 22074 leader_election.cc:288] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [CANDIDATE]: Term 1 election: Requested vote from peers 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487), 677a567948364495971f3b53b45a24ba (127.19.77.131:42069)
I20260805 22:37:18.056677 21852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d6bbbf1868b496fb507e917bbdf1e3d" candidate_uuid: "f5ac6bcdf229473d8c75819a250d3b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eeb459c63f045a9b1179d6c272c32d1"
I20260805 22:37:18.056681 21995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d6bbbf1868b496fb507e917bbdf1e3d" candidate_uuid: "f5ac6bcdf229473d8c75819a250d3b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "677a567948364495971f3b53b45a24ba"
I20260805 22:37:18.056758 21852 raft_consensus.cc:3037] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:18.056763 21995 raft_consensus.cc:3037] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:18.057607 21995 raft_consensus.cc:2454] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac6bcdf229473d8c75819a250d3b61 in term 1.
I20260805 22:37:18.057611 21852 raft_consensus.cc:2454] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ac6bcdf229473d8c75819a250d3b61 in term 1.
I20260805 22:37:18.057780 21636 leader_election.cc:302] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eeb459c63f045a9b1179d6c272c32d1, f5ac6bcdf229473d8c75819a250d3b61; no voters:
I20260805 22:37:18.057898 22074 raft_consensus.cc:2781] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:18.058092 22074 raft_consensus.cc:686] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 1 LEADER]: Becoming Leader. State: Replica: f5ac6bcdf229473d8c75819a250d3b61, State: Running, Role: LEADER
I20260805 22:37:18.058177 22074 consensus_queue.cc:237] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:18.058948 21547 catalog_manager.cc:5495] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129). New cstate: current_term: 1 leader_uuid: "f5ac6bcdf229473d8c75819a250d3b61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } health_report { overall_health: UNKNOWN } } }
I20260805 22:37:18.070948 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:18.067651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57210 (local address 127.19.77.129:44965)
0805 22:37:18.067717 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:18.067719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:18.067729 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:18.067771 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:18.067772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:18.067798 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:18.067879 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:18.068067 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.068836 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.069927 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.070244 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.070319 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.070513 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:18.070657 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:18.070737 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:18.070807 (+ 70us) server_negotiation.cc:299] Negotiation successful
0805 22:37:18.070836 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260805 22:37:18.077580 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:18.074159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:38913 (local address 127.19.77.130:39487)
0805 22:37:18.074207 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:18.074209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:18.074363 (+ 154us) server_negotiation.cc:407] Connection header received
0805 22:37:18.074399 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:18.074400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:18.074412 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:18.074511 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:18.074688 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.075499 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.076680 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.076979 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.077065 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.077295 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:18.077333 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:18.077394 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:18.077467 (+ 73us) server_negotiation.cc:299] Negotiation successful
0805 22:37:18.077492 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:37:18.077623 22125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:18.074069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:39487 (local address 127.19.77.129:38913)
0805 22:37:18.074270 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:18.074284 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:18.074351 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:18.074504 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:18.074504 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:18.074506 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:18.074595 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:18.074597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.075615 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.075616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:18.076562 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:18.076565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.077074 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.077075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:18.077159 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.077185 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:18.077410 (+ 225us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:18.077412 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:37:18.077462 (+ 50us) client_negotiation.cc:240] Negotiation successful
0805 22:37:18.077510 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
I20260805 22:37:18.081266 21995 raft_consensus.cc:1261] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Refusing update from remote peer f5ac6bcdf229473d8c75819a250d3b61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:18.081278 21852 raft_consensus.cc:1261] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Refusing update from remote peer f5ac6bcdf229473d8c75819a250d3b61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:18.081558 22121 consensus_queue.cc:1035] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:18.081678 22074 consensus_queue.cc:1035] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:18.085196 22095 mvcc.cc:205] Tried to move back new op lower bound from 7315330818378563584 to 7315330818286866432. Current Snapshot: MvccSnapshot[applied={T|T < 7315330818378563584}]
I20260805 22:37:18.092653 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:18.089618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:44965 (local address 127.19.77.130:36947)
0805 22:37:18.089720 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:18.089732 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:18.089773 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:18.089936 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:18.089938 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:18.089939 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:18.089989 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:18.089991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.090844 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.090845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:18.091725 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:18.091729 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.092232 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.092233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:18.092290 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.092295 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:18.092453 (+ 158us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:18.092454 (+ 1us) client_negotiation.cc:769] Sending connection context
0805 22:37:18.092489 (+ 35us) client_negotiation.cc:240] Negotiation successful
0805 22:37:18.092541 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260805 22:37:18.093127 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:18.089713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:36947 (local address 127.19.77.129:44965)
0805 22:37:18.089755 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:18.089757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:18.089766 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:18.089826 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:18.089826 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:18.089837 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:18.089887 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:18.090057 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.090736 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.091827 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:18.092136 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:18.092197 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:18.092362 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:18.092397 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:18.092435 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:18.093019 (+ 584us) server_negotiation.cc:299] Negotiation successful
0805 22:37:18.093043 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260805 22:37:18.093973 22094 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260805 22:37:19.628185 21545 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:19.628324 21545 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:19.629518 21545 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5: Sending DeleteTablet for 3 replicas of tablet 1d6bbbf1868b496fb507e917bbdf1e3d
I20260805 22:37:19.629846 21687 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d6bbbf1868b496fb507e917bbdf1e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:19 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:57196
I20260805 22:37:19.629879 21975 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d6bbbf1868b496fb507e917bbdf1e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:19 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:60934
I20260805 22:37:19.629956 21832 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d6bbbf1868b496fb507e917bbdf1e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:19 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:43678
I20260805 22:37:19.630123 22152 tablet_replica.cc:330] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba: stopping tablet replica
I20260805 22:37:19.630187 22152 raft_consensus.cc:2229] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:19.630494 22152 raft_consensus.cc:2258] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:19.630723 22153 tablet_replica.cc:330] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1: stopping tablet replica
I20260805 22:37:19.630853 22152 ts_tablet_manager.cc:1905] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:19.630939 22153 raft_consensus.cc:2229] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:19.631093 22153 raft_consensus.cc:2258] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:19.631086 22151 tablet_replica.cc:330] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61: stopping tablet replica
I20260805 22:37:19.631170 22151 raft_consensus.cc:2229] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:19.631274 22151 raft_consensus.cc:2258] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:19.631438 22153 ts_tablet_manager.cc:1905] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:19.631534 22151 ts_tablet_manager.cc:1905] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:19.633148 22152 ts_tablet_manager.cc:1918] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:37:19.633212 22152 log.cc:1196] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/1d6bbbf1868b496fb507e917bbdf1e3d
I20260805 22:37:19.633462 22152 ts_tablet_manager.cc:1939] T 1d6bbbf1868b496fb507e917bbdf1e3d P 677a567948364495971f3b53b45a24ba: Deleting consensus metadata
I20260805 22:37:19.633522 22153 ts_tablet_manager.cc:1918] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:37:19.633586 22153 log.cc:1196] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/1d6bbbf1868b496fb507e917bbdf1e3d
I20260805 22:37:19.633901 21531 catalog_manager.cc:4841] TS 677a567948364495971f3b53b45a24ba (127.19.77.131:42069): tablet 1d6bbbf1868b496fb507e917bbdf1e3d (table test-table [id=0891ac13329e4bcebad61ea807586637]) successfully deleted
I20260805 22:37:19.634172 22153 ts_tablet_manager.cc:1939] T 1d6bbbf1868b496fb507e917bbdf1e3d P 4eeb459c63f045a9b1179d6c272c32d1: Deleting consensus metadata
I20260805 22:37:19.634490 22151 ts_tablet_manager.cc:1918] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:37:19.634557 22151 log.cc:1196] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/1d6bbbf1868b496fb507e917bbdf1e3d
I20260805 22:37:19.634588 21531 catalog_manager.cc:4841] TS 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487): tablet 1d6bbbf1868b496fb507e917bbdf1e3d (table test-table [id=0891ac13329e4bcebad61ea807586637]) successfully deleted
I20260805 22:37:19.634806 22151 ts_tablet_manager.cc:1939] T 1d6bbbf1868b496fb507e917bbdf1e3d P f5ac6bcdf229473d8c75819a250d3b61: Deleting consensus metadata
I20260805 22:37:19.635193 21533 catalog_manager.cc:4841] TS f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965): tablet 1d6bbbf1868b496fb507e917bbdf1e3d (table test-table [id=0891ac13329e4bcebad61ea807586637]) successfully deleted
Aug 05 22:37:19 dist-test-slave-chsk krb5kdc[21500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:37:19 dist-test-slave-chsk krb5kdc[21500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:19.658950 22161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:19.650440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38882 (local address 127.19.77.190:44387)
0805 22:37:19.650619 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:19.650621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:19.650634 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:37:19.650702 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:19.650703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:19.650714 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:19.650792 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:19.651527 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:19.652049 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:19.652802 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:19.652998 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:19.653059 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:19.656031 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:19.656033 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:19.656034 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:19.656050 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:19.657677 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:19.658071 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:19.658073 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:19.658073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:19.658144 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:19.658362 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:19.658363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:19.658363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:19.658496 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:19.658612 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:19.658725 (+ 113us) server_negotiation.cc:299] Negotiation successful
0805 22:37:19.658819 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":118,"threads_started":1}
I20260805 22:37:19.660725 21545 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:19.660893 21545 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:19.662542 21832 tablet_service.cc:1467] Processing CreateTablet for tablet 2d34b122915944959902f686061144da (DEFAULT_TABLE table=test-table [id=209fb7371a05407a80894f49f75dc3f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:19.662557 21975 tablet_service.cc:1467] Processing CreateTablet for tablet 2d34b122915944959902f686061144da (DEFAULT_TABLE table=test-table [id=209fb7371a05407a80894f49f75dc3f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:19.662544 21687 tablet_service.cc:1467] Processing CreateTablet for tablet 2d34b122915944959902f686061144da (DEFAULT_TABLE table=test-table [id=209fb7371a05407a80894f49f75dc3f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:19.662714 21832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d34b122915944959902f686061144da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:19.662714 21687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d34b122915944959902f686061144da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:19.662725 21975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d34b122915944959902f686061144da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:19.664376 22163 tablet_bootstrap.cc:492] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61: Bootstrap starting.
I20260805 22:37:19.664413 22162 tablet_bootstrap.cc:492] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba: Bootstrap starting.
I20260805 22:37:19.664520 22164 tablet_bootstrap.cc:492] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1: Bootstrap starting.
I20260805 22:37:19.664816 22163 tablet_bootstrap.cc:654] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:19.664816 22162 tablet_bootstrap.cc:654] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:19.664965 22164 tablet_bootstrap.cc:654] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:19.665477 22162 tablet_bootstrap.cc:492] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba: No bootstrap required, opened a new log
I20260805 22:37:19.665482 22163 tablet_bootstrap.cc:492] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61: No bootstrap required, opened a new log
I20260805 22:37:19.665522 22162 ts_tablet_manager.cc:1397] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:19.665550 22163 ts_tablet_manager.cc:1397] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:19.665657 22162 raft_consensus.cc:348] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.665763 22162 raft_consensus.cc:374] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:19.665709 22163 raft_consensus.cc:348] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.665792 22162 raft_consensus.cc:729] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677a567948364495971f3b53b45a24ba, State: Initialized, Role: FOLLOWER
I20260805 22:37:19.665793 22163 raft_consensus.cc:374] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:19.665814 22163 raft_consensus.cc:729] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac6bcdf229473d8c75819a250d3b61, State: Initialized, Role: FOLLOWER
I20260805 22:37:19.665839 22162 consensus_queue.cc:260] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.665859 22163 consensus_queue.cc:260] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.665957 22163 ts_tablet_manager.cc:1428] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:19.666039 22162 ts_tablet_manager.cc:1428] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:19.666756 22164 tablet_bootstrap.cc:492] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1: No bootstrap required, opened a new log
I20260805 22:37:19.666821 22164 ts_tablet_manager.cc:1397] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:19.667016 22164 raft_consensus.cc:348] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.667100 22164 raft_consensus.cc:374] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:19.667171 22164 raft_consensus.cc:729] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eeb459c63f045a9b1179d6c272c32d1, State: Initialized, Role: FOLLOWER
I20260805 22:37:19.667230 22164 consensus_queue.cc:260] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.667338 22164 ts_tablet_manager.cc:1428] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:19.724486 22168 raft_consensus.cc:482] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:19.724627 22168 raft_consensus.cc:504] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.724862 22168 leader_election.cc:288] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965), 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487)
I20260805 22:37:19.725068 21707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34b122915944959902f686061144da" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac6bcdf229473d8c75819a250d3b61" is_pre_election: true
I20260805 22:37:19.725183 21707 raft_consensus.cc:2454] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 0.
I20260805 22:37:19.725153 21852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34b122915944959902f686061144da" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eeb459c63f045a9b1179d6c272c32d1" is_pre_election: true
I20260805 22:37:19.725263 21852 raft_consensus.cc:2454] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 0.
I20260805 22:37:19.725407 21926 leader_election.cc:302] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 677a567948364495971f3b53b45a24ba, f5ac6bcdf229473d8c75819a250d3b61; no voters:
I20260805 22:37:19.725520 22168 raft_consensus.cc:2781] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:19.725561 22168 raft_consensus.cc:482] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:19.725580 22168 raft_consensus.cc:3037] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:19.726351 22168 raft_consensus.cc:504] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.726503 22168 leader_election.cc:288] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 election: Requested vote from peers f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965), 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487)
I20260805 22:37:19.726692 21852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34b122915944959902f686061144da" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eeb459c63f045a9b1179d6c272c32d1"
I20260805 22:37:19.726702 21707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d34b122915944959902f686061144da" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac6bcdf229473d8c75819a250d3b61"
I20260805 22:37:19.726799 21707 raft_consensus.cc:3037] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:19.726802 21852 raft_consensus.cc:3037] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:19.727589 21852 raft_consensus.cc:2454] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 1.
I20260805 22:37:19.727618 21707 raft_consensus.cc:2454] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 1.
I20260805 22:37:19.727798 21924 leader_election.cc:302] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eeb459c63f045a9b1179d6c272c32d1, 677a567948364495971f3b53b45a24ba; no voters:
I20260805 22:37:19.727918 22168 raft_consensus.cc:2781] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:19.728084 22168 raft_consensus.cc:686] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 1 LEADER]: Becoming Leader. State: Replica: 677a567948364495971f3b53b45a24ba, State: Running, Role: LEADER
I20260805 22:37:19.728183 22168 consensus_queue.cc:237] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.728920 21545 catalog_manager.cc:5495] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 677a567948364495971f3b53b45a24ba (127.19.77.131). New cstate: current_term: 1 leader_uuid: "677a567948364495971f3b53b45a24ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } health_report { overall_health: HEALTHY } } }
I20260805 22:37:19.745973 22172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:19.743481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60952 (local address 127.19.77.131:42069)
0805 22:37:19.743661 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:19.743662 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:19.743668 (+ 6us) server_negotiation.cc:407] Connection header received
0805 22:37:19.743688 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:19.743688 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:19.743698 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:19.743781 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:19.743938 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:19.744438 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:19.745226 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:19.745444 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:19.745522 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:19.745687 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:19.745730 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:19.745787 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:19.745846 (+ 59us) server_negotiation.cc:299] Negotiation successful
0805 22:37:19.745871 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":97,"threads_started":1}
I20260805 22:37:19.749711 21852 raft_consensus.cc:1261] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Refusing update from remote peer 677a567948364495971f3b53b45a24ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:19.749764 21707 raft_consensus.cc:1261] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Refusing update from remote peer 677a567948364495971f3b53b45a24ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:19.749964 22168 consensus_queue.cc:1035] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:19.750125 22169 consensus_queue.cc:1035] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:19.761462 21545 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:19.761595 21545 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:19.762298 21545 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5: Sending DeleteTablet for 3 replicas of tablet 2d34b122915944959902f686061144da
I20260805 22:37:19.762588 21687 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d34b122915944959902f686061144da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:19 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:57196
I20260805 22:37:19.762596 21832 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d34b122915944959902f686061144da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:19 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:43678
I20260805 22:37:19.762596 21975 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d34b122915944959902f686061144da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:19 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:60934
I20260805 22:37:19.762701 22152 tablet_replica.cc:330] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba: stopping tablet replica
I20260805 22:37:19.762737 22153 tablet_replica.cc:330] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1: stopping tablet replica
I20260805 22:37:19.762779 22152 raft_consensus.cc:2229] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:19.762816 22153 raft_consensus.cc:2229] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:19.762850 22152 raft_consensus.cc:2258] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:19.762858 22153 raft_consensus.cc:2258] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:19.762946 22151 tablet_replica.cc:330] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61: stopping tablet replica
I20260805 22:37:19.763007 22151 raft_consensus.cc:2229] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:19.763046 22151 raft_consensus.cc:2258] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:19.763044 21545 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:19.763245 21545 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:19.763396 22151 ts_tablet_manager.cc:1905] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:19.763410 22153 ts_tablet_manager.cc:1905] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:19.763473 22152 ts_tablet_manager.cc:1905] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:19.765224 22152 ts_tablet_manager.cc:1918] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:19.765236 22151 ts_tablet_manager.cc:1918] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:19.765236 22153 ts_tablet_manager.cc:1918] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:19.765288 22152 log.cc:1196] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/2d34b122915944959902f686061144da
I20260805 22:37:19.765295 22151 log.cc:1196] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/2d34b122915944959902f686061144da
I20260805 22:37:19.765295 22153 log.cc:1196] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/2d34b122915944959902f686061144da
I20260805 22:37:19.765548 22152 ts_tablet_manager.cc:1939] T 2d34b122915944959902f686061144da P 677a567948364495971f3b53b45a24ba: Deleting consensus metadata
I20260805 22:37:19.765573 22151 ts_tablet_manager.cc:1939] T 2d34b122915944959902f686061144da P f5ac6bcdf229473d8c75819a250d3b61: Deleting consensus metadata
I20260805 22:37:19.765573 22153 ts_tablet_manager.cc:1939] T 2d34b122915944959902f686061144da P 4eeb459c63f045a9b1179d6c272c32d1: Deleting consensus metadata
I20260805 22:37:19.765923 21533 catalog_manager.cc:4841] TS f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965): tablet 2d34b122915944959902f686061144da (table test-table [id=209fb7371a05407a80894f49f75dc3f6]) successfully deleted
I20260805 22:37:19.765956 21531 catalog_manager.cc:4841] TS 677a567948364495971f3b53b45a24ba (127.19.77.131:42069): tablet 2d34b122915944959902f686061144da (table test-table [id=209fb7371a05407a80894f49f75dc3f6]) successfully deleted
I20260805 22:37:19.766214 21531 catalog_manager.cc:4841] TS 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487): tablet 2d34b122915944959902f686061144da (table test-table [id=209fb7371a05407a80894f49f75dc3f6]) successfully deleted
I20260805 22:37:19.766636 21687 tablet_service.cc:1467] Processing CreateTablet for tablet 17065d5610644e76a2594153b417c380 (DEFAULT_TABLE table=test-table [id=1c082084b05f48d49a12e8620b30304c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:19.766667 21832 tablet_service.cc:1467] Processing CreateTablet for tablet 17065d5610644e76a2594153b417c380 (DEFAULT_TABLE table=test-table [id=1c082084b05f48d49a12e8620b30304c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:19.766697 21975 tablet_service.cc:1467] Processing CreateTablet for tablet 17065d5610644e76a2594153b417c380 (DEFAULT_TABLE table=test-table [id=1c082084b05f48d49a12e8620b30304c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:19.766763 21687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17065d5610644e76a2594153b417c380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:19.766780 21832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17065d5610644e76a2594153b417c380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:19.766798 21975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17065d5610644e76a2594153b417c380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:19.767825 22163 tablet_bootstrap.cc:492] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61: Bootstrap starting.
I20260805 22:37:19.768072 22164 tablet_bootstrap.cc:492] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1: Bootstrap starting.
I20260805 22:37:19.768072 22162 tablet_bootstrap.cc:492] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: Bootstrap starting.
I20260805 22:37:19.768229 22163 tablet_bootstrap.cc:654] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:19.768417 22164 tablet_bootstrap.cc:654] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:19.768417 22162 tablet_bootstrap.cc:654] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:19.769030 22162 tablet_bootstrap.cc:492] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: No bootstrap required, opened a new log
I20260805 22:37:19.769088 22162 ts_tablet_manager.cc:1397] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:19.769209 22163 tablet_bootstrap.cc:492] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61: No bootstrap required, opened a new log
I20260805 22:37:19.769266 22163 ts_tablet_manager.cc:1397] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:19.769274 22162 raft_consensus.cc:348] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.769359 22162 raft_consensus.cc:374] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:19.769387 22162 raft_consensus.cc:729] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677a567948364495971f3b53b45a24ba, State: Initialized, Role: FOLLOWER
I20260805 22:37:19.769371 22163 raft_consensus.cc:348] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.769445 22163 raft_consensus.cc:374] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:19.769434 22162 consensus_queue.cc:260] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.769470 22163 raft_consensus.cc:729] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac6bcdf229473d8c75819a250d3b61, State: Initialized, Role: FOLLOWER
I20260805 22:37:19.769511 22163 consensus_queue.cc:260] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.769539 22162 ts_tablet_manager.cc:1428] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:19.769598 22163 ts_tablet_manager.cc:1428] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260805 22:37:19.771517 22043 tablet.cc:2369] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:37:19.771809 22164 tablet_bootstrap.cc:492] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1: No bootstrap required, opened a new log
I20260805 22:37:19.771878 22164 ts_tablet_manager.cc:1397] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260805 22:37:19.772008 22164 raft_consensus.cc:348] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.772095 22164 raft_consensus.cc:374] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:19.772130 22164 raft_consensus.cc:729] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eeb459c63f045a9b1179d6c272c32d1, State: Initialized, Role: FOLLOWER
I20260805 22:37:19.772186 22164 consensus_queue.cc:260] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.772297 22164 ts_tablet_manager.cc:1428] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:19.861307 22176 raft_consensus.cc:482] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:19.861438 22176 raft_consensus.cc:504] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.861660 22176 leader_election.cc:288] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965), 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487)
I20260805 22:37:19.862169 21852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17065d5610644e76a2594153b417c380" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eeb459c63f045a9b1179d6c272c32d1" is_pre_election: true
I20260805 22:37:19.862169 21707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17065d5610644e76a2594153b417c380" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac6bcdf229473d8c75819a250d3b61" is_pre_election: true
I20260805 22:37:19.862442 21707 raft_consensus.cc:2454] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 0.
I20260805 22:37:19.862442 21852 raft_consensus.cc:2454] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 0.
I20260805 22:37:19.862668 21924 leader_election.cc:302] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eeb459c63f045a9b1179d6c272c32d1, 677a567948364495971f3b53b45a24ba; no voters:
I20260805 22:37:19.862864 22176 raft_consensus.cc:2781] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:19.862946 22176 raft_consensus.cc:482] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:19.862975 22176 raft_consensus.cc:3037] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:19.864173 22176 raft_consensus.cc:504] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.864524 22176 leader_election.cc:288] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 election: Requested vote from peers f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965), 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487)
I20260805 22:37:19.864746 21707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17065d5610644e76a2594153b417c380" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ac6bcdf229473d8c75819a250d3b61"
I20260805 22:37:19.864744 21852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17065d5610644e76a2594153b417c380" candidate_uuid: "677a567948364495971f3b53b45a24ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eeb459c63f045a9b1179d6c272c32d1"
I20260805 22:37:19.864843 21707 raft_consensus.cc:3037] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:19.864843 21852 raft_consensus.cc:3037] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:19.865738 21852 raft_consensus.cc:2454] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 1.
I20260805 22:37:19.865738 21707 raft_consensus.cc:2454] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 677a567948364495971f3b53b45a24ba in term 1.
I20260805 22:37:19.865963 21924 leader_election.cc:302] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4eeb459c63f045a9b1179d6c272c32d1, 677a567948364495971f3b53b45a24ba, f5ac6bcdf229473d8c75819a250d3b61; no voters:
I20260805 22:37:19.866137 22176 raft_consensus.cc:2781] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:19.866214 22176 raft_consensus.cc:686] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 1 LEADER]: Becoming Leader. State: Replica: 677a567948364495971f3b53b45a24ba, State: Running, Role: LEADER
I20260805 22:37:19.866274 22176 consensus_queue.cc:237] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } }
I20260805 22:37:19.867012 21547 catalog_manager.cc:5495] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 677a567948364495971f3b53b45a24ba (127.19.77.131). New cstate: current_term: 1 leader_uuid: "677a567948364495971f3b53b45a24ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "677a567948364495971f3b53b45a24ba" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42069 } health_report { overall_health: HEALTHY } } }
I20260805 22:37:19.891021 21852 raft_consensus.cc:1261] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Refusing update from remote peer 677a567948364495971f3b53b45a24ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:19.891060 21707 raft_consensus.cc:1261] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Refusing update from remote peer 677a567948364495971f3b53b45a24ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:19.891279 22168 consensus_queue.cc:1035] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eeb459c63f045a9b1179d6c272c32d1" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:19.891494 22168 consensus_queue.cc:1035] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac6bcdf229473d8c75819a250d3b61" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 44965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:37:19.896171 22134 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260805 22:37:21.415920 21545 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:21.416043 21545 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:21.417241 21545 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f73b148e01d144fb9f32face58421bb5: Sending DeleteTablet for 3 replicas of tablet 17065d5610644e76a2594153b417c380
I20260805 22:37:21.417598 21975 tablet_service.cc:1514] Processing DeleteTablet for tablet 17065d5610644e76a2594153b417c380 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:21 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:60934
I20260805 22:37:21.417599 21687 tablet_service.cc:1514] Processing DeleteTablet for tablet 17065d5610644e76a2594153b417c380 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:21 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:57196
I20260805 22:37:21.417665 21832 tablet_service.cc:1514] Processing DeleteTablet for tablet 17065d5610644e76a2594153b417c380 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:21 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:43678
I20260805 22:37:21.417899 22204 tablet_replica.cc:330] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61: stopping tablet replica
I20260805 22:37:21.417966 22204 raft_consensus.cc:2229] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:21.418026 22204 raft_consensus.cc:2258] T 17065d5610644e76a2594153b417c380 P f5ac6bcdf229473d8c75819a250d3b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:21.418031 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 21620
I20260805 22:37:21.423336 22207 tablet_replica.cc:330] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: stopping tablet replica
I20260805 22:37:21.423336 22208 tablet_replica.cc:330] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1: stopping tablet replica
I20260805 22:37:21.423442 22207 raft_consensus.cc:2229] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:21.423442 22208 raft_consensus.cc:2229] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:21.423504 22208 raft_consensus.cc:2258] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:21.423568 22207 raft_consensus.cc:2258] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:21.423869 22207 ts_tablet_manager.cc:1905] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:21.423934 22208 ts_tablet_manager.cc:1905] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:21.426029 22207 ts_tablet_manager.cc:1918] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:37:21.426029 22208 ts_tablet_manager.cc:1918] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:37:21.426105 22208 log.cc:1196] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/17065d5610644e76a2594153b417c380
I20260805 22:37:21.426105 22207 log.cc:1196] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/17065d5610644e76a2594153b417c380
I20260805 22:37:21.426359 22208 ts_tablet_manager.cc:1939] T 17065d5610644e76a2594153b417c380 P 4eeb459c63f045a9b1179d6c272c32d1: Deleting consensus metadata
I20260805 22:37:21.426369 22207 ts_tablet_manager.cc:1939] T 17065d5610644e76a2594153b417c380 P 677a567948364495971f3b53b45a24ba: Deleting consensus metadata
I20260805 22:37:21.426805 21531 catalog_manager.cc:4841] TS 677a567948364495971f3b53b45a24ba (127.19.77.131:42069): tablet 17065d5610644e76a2594153b417c380 (table test-table [id=1c082084b05f48d49a12e8620b30304c]) successfully deleted
I20260805 22:37:21.426885 21531 catalog_manager.cc:4841] TS 4eeb459c63f045a9b1179d6c272c32d1 (127.19.77.130:39487): tablet 17065d5610644e76a2594153b417c380 (table test-table [id=1c082084b05f48d49a12e8620b30304c]) successfully deleted
W20260805 22:37:21.427381 21533 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:44965 (error 108)
I20260805 22:37:21.427613 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 21764
I20260805 22:37:21.435513 22210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:21.427846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:44965 (local address 127.0.0.1:57226)
0805 22:37:21.435349 (+ 7503us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:21.435432 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:44965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7452,"thread_start_us":65,"threads_started":1}
W20260805 22:37:21.435694 21533 catalog_manager.cc:4584] TS f5ac6bcdf229473d8c75819a250d3b61 (127.19.77.129:44965): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 17065d5610644e76a2594153b417c380: Network error: Client connection negotiation failed: client connection to 127.19.77.129:44965: connect: Connection refused (error 111)
I20260805 22:37:21.436066 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 21908
I20260805 22:37:21.443449 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 21514
2026-08-05T22:37:21Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5536 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:21 dist-test-slave-chsk krb5kdc[22213](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:21 dist-test-slave-chsk krb5kdc[22213](info): set up 2 sockets
Aug 05 22:37:21 dist-test-slave-chsk krb5kdc[22213](info): commencing operation
krb5kdc: starting...
W20260805 22:37:22.514586 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:22 dist-test-slave-chsk krb5kdc[22213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:22.647838 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:36989
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:36989
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:22.734232 22226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:22.734458 22226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:22.734484 22226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:22.735764 22226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:22.735819 22226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:22.735834 22226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:22.735848 22226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:22.735860 22226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:22.737486 22226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:36989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:36989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:22.737769 22226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:22.738106 22226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:22.743306 22233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:22.743306 22232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:22.743331 22235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:22.743582 22226 server_base.cc:1034] running on GCE node
I20260805 22:37:22.743836 22226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:22.744165 22226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:22.745317 22226 hybrid_clock.cc:648] HybridClock initialized: now 1785969442745303 us; error 32 us; skew 500 ppm
Aug 05 22:37:22 dist-test-slave-chsk krb5kdc[22213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969442, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:22.747897 22226 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:22.748310 22226 webserver.cc:460] Webserver started at http://127.19.77.190:38011/ using document root <none> and password file <none>
I20260805 22:37:22.748499 22226 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:22.748549 22226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:22.748658 22226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:22.749744 22226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "f44d4a0a3a8644959347be1480ac8143"
format_stamp: "Formatted at 2026-08-05 22:37:22 on dist-test-slave-chsk"
server_key: "d3cfe462737b4e180026001e9663beb3"
server_key_iv: "38d5487b674e4e98275d71bc84d0e1e0"
server_key_version: "encryptionkey@0"
I20260805 22:37:22.750066 22226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "f44d4a0a3a8644959347be1480ac8143"
format_stamp: "Formatted at 2026-08-05 22:37:22 on dist-test-slave-chsk"
server_key: "d3cfe462737b4e180026001e9663beb3"
server_key_iv: "38d5487b674e4e98275d71bc84d0e1e0"
server_key_version: "encryptionkey@0"
I20260805 22:37:22.751459 22226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:37:22.752259 22243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:22.752499 22226 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:22.752593 22226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "f44d4a0a3a8644959347be1480ac8143"
format_stamp: "Formatted at 2026-08-05 22:37:22 on dist-test-slave-chsk"
server_key: "d3cfe462737b4e180026001e9663beb3"
server_key_iv: "38d5487b674e4e98275d71bc84d0e1e0"
server_key_version: "encryptionkey@0"
I20260805 22:37:22.752655 22226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:22.776414 22226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:22.778575 22226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:22.778703 22226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:22.783089 22226 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:36989
I20260805 22:37:22.783198 22295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:36989 every 8 connection(s)
I20260805 22:37:22.783597 22226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:22.783994 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 22226
I20260805 22:37:22.784124 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:22.784328 19766 external_mini_cluster.cc:1428] Setting key f9e5ce48595164322a0c2a34bc499499
I20260805 22:37:22.784785 22296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:22.788304 22296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143: Bootstrap starting.
I20260805 22:37:22.789036 22296 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:22.789368 22296 log.cc:824] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:22.790349 22296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143: No bootstrap required, opened a new log
Aug 05 22:37:22 dist-test-slave-chsk krb5kdc[22213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:22.792662 22296 raft_consensus.cc:348] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f44d4a0a3a8644959347be1480ac8143" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36989 } }
I20260805 22:37:22.792855 22296 raft_consensus.cc:374] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:22.792896 22296 raft_consensus.cc:729] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44d4a0a3a8644959347be1480ac8143, State: Initialized, Role: FOLLOWER
I20260805 22:37:22.793062 22296 consensus_queue.cc:260] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f44d4a0a3a8644959347be1480ac8143" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36989 } }
I20260805 22:37:22.793157 22296 raft_consensus.cc:388] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:22.793198 22296 raft_consensus.cc:482] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:22.793252 22296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:22.793900 22296 raft_consensus.cc:504] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f44d4a0a3a8644959347be1480ac8143" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36989 } }
I20260805 22:37:22.794050 22296 leader_election.cc:302] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f44d4a0a3a8644959347be1480ac8143; no voters:
I20260805 22:37:22.794269 22296 leader_election.cc:288] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:22.794308 22301 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:22.794427 22301 raft_consensus.cc:686] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [term 1 LEADER]: Becoming Leader. State: Replica: f44d4a0a3a8644959347be1480ac8143, State: Running, Role: LEADER
I20260805 22:37:22.794605 22296 sys_catalog.cc:564] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:22.794591 22301 consensus_queue.cc:237] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f44d4a0a3a8644959347be1480ac8143" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36989 } }
I20260805 22:37:22.795183 22302 sys_catalog.cc:455] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f44d4a0a3a8644959347be1480ac8143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f44d4a0a3a8644959347be1480ac8143" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36989 } } }
I20260805 22:37:22.795305 22302 sys_catalog.cc:458] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:22.796288 22303 sys_catalog.cc:455] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f44d4a0a3a8644959347be1480ac8143. Latest consensus state: current_term: 1 leader_uuid: "f44d4a0a3a8644959347be1480ac8143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f44d4a0a3a8644959347be1480ac8143" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36989 } } }
I20260805 22:37:22.796428 22303 sys_catalog.cc:458] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:22.796607 22308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:22.796619 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:22.784918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52664 (local address 127.19.77.190:36989)
0805 22:37:22.785129 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:22.785139 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:22.785172 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:37:22.785709 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:22.785718 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:22.785783 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:22.785945 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:22.786634 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:22.788048 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:22.788892 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:22.789565 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:22.789681 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:22.792265 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:22.792272 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:22.792273 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:22.792289 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:22.794329 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:22.794832 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:22.794835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:22.794835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:22.794966 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:22.795242 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:22.795244 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:22.795245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:22.795639 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:22.795777 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:22.796181 (+ 404us) server_negotiation.cc:299] Negotiation successful
0805 22:37:22.796368 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":126,"threads_started":1}
I20260805 22:37:22.797132 22308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:22.798724 22308 catalog_manager.cc:1347] Generated new cluster ID: be0784252e844d84b32f8f05bcdc964f
I20260805 22:37:22.798784 22308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:22.822510 22308 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:22.823314 22308 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:22.837908 22308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f44d4a0a3a8644959347be1480ac8143: Generated new TSK 0
I20260805 22:37:22.838164 22308 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:37:22.874571 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36989
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:22.963229 22323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:22.963496 22323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:22.963539 22323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:22.964788 22323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:22.964864 22323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:22.964913 22323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:22.966500 22323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:22.966789 22323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:22.967052 22323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:22.972523 22328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:22.972549 22329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:22.972594 22323 server_base.cc:1034] running on GCE node
W20260805 22:37:22.972549 22332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:22.973023 22323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:22.973317 22323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:22.974495 22323 hybrid_clock.cc:648] HybridClock initialized: now 1785969442974481 us; error 26 us; skew 500 ppm
Aug 05 22:37:22 dist-test-slave-chsk krb5kdc[22213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969442, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:22.977521 22323 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:37:22.978039 22323 webserver.cc:460] Webserver started at http://127.19.77.129:42681/ using document root <none> and password file <none>
I20260805 22:37:22.978294 22323 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:22.978370 22323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:22.978538 22323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:22.979774 22323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "3c0e996a80324528a0993a25df6a299a"
format_stamp: "Formatted at 2026-08-05 22:37:22 on dist-test-slave-chsk"
server_key: "9c7e83a5bfd46cd5c2d9340f2b1931fc"
server_key_iv: "656bf6ab365a73850c1671d3e80217c9"
server_key_version: "encryptionkey@0"
I20260805 22:37:22.980191 22323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "3c0e996a80324528a0993a25df6a299a"
format_stamp: "Formatted at 2026-08-05 22:37:22 on dist-test-slave-chsk"
server_key: "9c7e83a5bfd46cd5c2d9340f2b1931fc"
server_key_iv: "656bf6ab365a73850c1671d3e80217c9"
server_key_version: "encryptionkey@0"
I20260805 22:37:22.981782 22323 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:37:22.982790 22339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:22.983076 22323 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:22.983230 22323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "3c0e996a80324528a0993a25df6a299a"
format_stamp: "Formatted at 2026-08-05 22:37:22 on dist-test-slave-chsk"
server_key: "9c7e83a5bfd46cd5c2d9340f2b1931fc"
server_key_iv: "656bf6ab365a73850c1671d3e80217c9"
server_key_version: "encryptionkey@0"
I20260805 22:37:22.983323 22323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:22.999174 22323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:23.002161 22323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:23.002364 22323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:23.002656 22323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:23.003016 22323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:23.003077 22323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:23.003115 22323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:23.003253 22323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:23.010521 22323 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:39703
I20260805 22:37:23.010613 22455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:39703 every 8 connection(s)
I20260805 22:37:23.010991 22323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:23.011269 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 22323
I20260805 22:37:23.011384 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:23.011623 19766 external_mini_cluster.cc:1428] Setting key b654a98f95fe46ffe8f31e2501331bd6
Aug 05 22:37:23 dist-test-slave-chsk krb5kdc[22213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969442, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:37:23.025162 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:23.012570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:46191 (local address 127.19.77.190:36989)
0805 22:37:23.012633 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:23.012635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:23.012916 (+ 281us) server_negotiation.cc:407] Connection header received
0805 22:37:23.013615 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:23.013617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:23.013631 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:23.013696 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:23.015372 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.015935 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.017712 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.017940 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.018098 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:23.021527 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:23.021529 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:23.021529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:23.021545 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:23.023414 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:23.023916 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:23.023917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:23.023918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:23.024004 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:23.024289 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:23.024290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:23.024290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:23.024483 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:23.024582 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:23.024927 (+ 345us) server_negotiation.cc:299] Negotiation successful
0805 22:37:23.025059 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:37:23.025419 22458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:23.012490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:36989 (local address 127.19.77.129:46191)
0805 22:37:23.012744 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:23.012795 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:23.013493 (+ 698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:23.013807 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:23.013812 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:23.014803 (+ 991us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:23.015201 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:23.015209 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.016077 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.016078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:23.017574 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:23.017578 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.018131 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.018133 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:23.018332 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:23.019094 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:23.019107 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:23.021394 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:23.023524 (+ 2130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:23.023546 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:23.023549 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:23.023822 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:23.024086 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:23.024087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:23.024087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:23.024215 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:23.024573 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:23.024582 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:23.024772 (+ 190us) client_negotiation.cc:769] Sending connection context
0805 22:37:23.024894 (+ 122us) client_negotiation.cc:240] Negotiation successful
0805 22:37:23.025092 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":121,"threads_started":1}
I20260805 22:37:23.026331 22456 heartbeater.cc:347] Connected to a master server at 127.19.77.190:36989
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
I20260805 22:37:23.026481 22456 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:23.026710 22456 heartbeater.cc:511] Master 127.19.77.190:36989 requested a full tablet report, sending...
I20260805 22:37:23.027609 22260 ts_manager.cc:194] Registered new tserver with Master: 3c0e996a80324528a0993a25df6a299a (127.19.77.129:39703)
I20260805 22:37:23.028564 22260 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:46191
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:37:23.046597 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36989
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:23.133205 22461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:23.133471 22461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:23.133514 22461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:23.134774 22461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:23.134850 22461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:23.134898 22461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:23.136555 22461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:23.136858 22461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:23.137116 22461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:23.142678 22469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:23.142678 22467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:23.142700 22466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:23.142978 22461 server_base.cc:1034] running on GCE node
I20260805 22:37:23.143266 22461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:23.143568 22461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:23.144742 22461 hybrid_clock.cc:648] HybridClock initialized: now 1785969443144720 us; error 40 us; skew 500 ppm
Aug 05 22:37:23 dist-test-slave-chsk krb5kdc[22213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969443, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:23.147425 22461 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:37:23.147866 22461 webserver.cc:460] Webserver started at http://127.19.77.130:44061/ using document root <none> and password file <none>
I20260805 22:37:23.148121 22461 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:23.148169 22461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:23.148325 22461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:23.149459 22461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "37da487d78c449199d99e56f0e9a3562"
format_stamp: "Formatted at 2026-08-05 22:37:23 on dist-test-slave-chsk"
server_key: "1898f6a11b22b0cf746c47720f504c34"
server_key_iv: "8bf8903c772a81628a4e6dd41c7da878"
server_key_version: "encryptionkey@0"
I20260805 22:37:23.149842 22461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "37da487d78c449199d99e56f0e9a3562"
format_stamp: "Formatted at 2026-08-05 22:37:23 on dist-test-slave-chsk"
server_key: "1898f6a11b22b0cf746c47720f504c34"
server_key_iv: "8bf8903c772a81628a4e6dd41c7da878"
server_key_version: "encryptionkey@0"
I20260805 22:37:23.151407 22461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:23.152316 22476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:23.152513 22461 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:23.152590 22461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "37da487d78c449199d99e56f0e9a3562"
format_stamp: "Formatted at 2026-08-05 22:37:23 on dist-test-slave-chsk"
server_key: "1898f6a11b22b0cf746c47720f504c34"
server_key_iv: "8bf8903c772a81628a4e6dd41c7da878"
server_key_version: "encryptionkey@0"
I20260805 22:37:23.152693 22461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:23.161446 22461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:23.163728 22461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:23.163909 22461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:23.164184 22461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:23.164499 22461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:23.164554 22461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:23.164600 22461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:23.164623 22461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:23.170965 22461 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:33835
I20260805 22:37:23.171015 22595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:33835 every 8 connection(s)
I20260805 22:37:23.171423 22461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:23.173200 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 22461
I20260805 22:37:23.173285 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:23.173491 19766 external_mini_cluster.cc:1428] Setting key 32b2dc8b31089ae55e466d58257a661e
Aug 05 22:37:23 dist-test-slave-chsk krb5kdc[22213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969443, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
I20260805 22:37:23.182449 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:23.172204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:46581 (local address 127.19.77.190:36989)
0805 22:37:23.172307 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:23.172310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:23.172498 (+ 188us) server_negotiation.cc:407] Connection header received
0805 22:37:23.172983 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:23.172984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:23.172993 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:23.173046 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:23.174949 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.175518 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.176726 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.176925 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.177015 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:23.179549 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:23.179551 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:23.179552 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:23.179562 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:23.180968 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:23.181412 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:23.181414 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:23.181414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:23.181474 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:23.181739 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:23.181740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:23.181740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:23.181864 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:23.181975 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:23.182268 (+ 293us) server_negotiation.cc:299] Negotiation successful
0805 22:37:23.182357 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 22:37:23.182641 22599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:23.172176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:36989 (local address 127.19.77.130:46581)
0805 22:37:23.172377 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:23.172413 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:23.172901 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:23.173713 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:23.173719 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:23.174544 (+ 825us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:23.174847 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:23.174854 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.175616 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.175617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:23.176627 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:23.176630 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.177028 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.177029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:23.177181 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:23.177752 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:23.177763 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:23.179446 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:23.181074 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:23.181083 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:23.181085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:23.181321 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:23.181547 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:23.181548 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:23.181548 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:23.181662 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:23.181967 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:23.181975 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:23.182129 (+ 154us) client_negotiation.cc:769] Sending connection context
0805 22:37:23.182236 (+ 107us) client_negotiation.cc:240] Negotiation successful
0805 22:37:23.182403 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":122,"threads_started":1}
I20260805 22:37:23.183131 22596 heartbeater.cc:347] Connected to a master server at 127.19.77.190:36989
I20260805 22:37:23.183297 22596 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:23.183488 22596 heartbeater.cc:511] Master 127.19.77.190:36989 requested a full tablet report, sending...
I20260805 22:37:23.184057 22260 ts_manager.cc:194] Registered new tserver with Master: 37da487d78c449199d99e56f0e9a3562 (127.19.77.130:33835)
I20260805 22:37:23.184406 22260 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:46581
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:37:23.201813 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36989
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:23.286581 22602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:23.286880 22602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:23.286922 22602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:23.288208 22602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:23.288283 22602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:23.288332 22602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:23.289855 22602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:23.290167 22602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:23.290433 22602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:23.295811 22607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:23.295867 22602 server_base.cc:1034] running on GCE node
W20260805 22:37:23.295830 22608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:23.295811 22611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:23.296304 22602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:23.296628 22602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:23.297813 22602 hybrid_clock.cc:648] HybridClock initialized: now 1785969443297788 us; error 37 us; skew 500 ppm
Aug 05 22:37:23 dist-test-slave-chsk krb5kdc[22213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969443, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:23.300563 22602 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:37:23.300976 22602 webserver.cc:460] Webserver started at http://127.19.77.131:35449/ using document root <none> and password file <none>
I20260805 22:37:23.301229 22602 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:23.301276 22602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:23.301410 22602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:23.302500 22602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "74b53acbbea742238407740c8a1dcbfc"
format_stamp: "Formatted at 2026-08-05 22:37:23 on dist-test-slave-chsk"
server_key: "1e6f6b55c80ebdcfdb43050f4464c9f2"
server_key_iv: "c95115311e61515f8172fedbbd311e63"
server_key_version: "encryptionkey@0"
I20260805 22:37:23.302901 22602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "74b53acbbea742238407740c8a1dcbfc"
format_stamp: "Formatted at 2026-08-05 22:37:23 on dist-test-slave-chsk"
server_key: "1e6f6b55c80ebdcfdb43050f4464c9f2"
server_key_iv: "c95115311e61515f8172fedbbd311e63"
server_key_version: "encryptionkey@0"
I20260805 22:37:23.304421 22602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:23.305342 22618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:23.305583 22602 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:23.305698 22602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "74b53acbbea742238407740c8a1dcbfc"
format_stamp: "Formatted at 2026-08-05 22:37:23 on dist-test-slave-chsk"
server_key: "1e6f6b55c80ebdcfdb43050f4464c9f2"
server_key_iv: "c95115311e61515f8172fedbbd311e63"
server_key_version: "encryptionkey@0"
I20260805 22:37:23.305775 22602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:23.320683 22602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:23.323271 22602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:23.323447 22602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:23.323714 22602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:23.324038 22602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:23.324092 22602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:23.324138 22602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:23.324160 22602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:23.330413 22602 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:40197
I20260805 22:37:23.330493 22735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:40197 every 8 connection(s)
I20260805 22:37:23.330857 22602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:37:23 dist-test-slave-chsk krb5kdc[22213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969443, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:23.338028 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 22602
I20260805 22:37:23.338135 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:23.338358 19766 external_mini_cluster.cc:1428] Setting key 3445417fe22497e5f1692f256e4ee3d8
I20260805 22:37:23.341708 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:23.331723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:44189 (local address 127.19.77.190:36989)
0805 22:37:23.331773 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:23.331776 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:23.331971 (+ 195us) server_negotiation.cc:407] Connection header received
0805 22:37:23.332788 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:23.332790 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:23.332806 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:23.332894 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:23.333948 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.334460 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.335628 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.335832 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.335914 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:23.338541 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:23.338545 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:23.338545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:23.338559 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:23.340262 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:23.340736 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:23.340736 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:23.340737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:23.340795 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:23.341033 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:23.341033 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:23.341034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:23.341151 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:23.341210 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:23.341559 (+ 349us) server_negotiation.cc:299] Negotiation successful
0805 22:37:23.341639 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:37:23.341866 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:23.331671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:36989 (local address 127.19.77.131:44189)
0805 22:37:23.331829 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:23.331881 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:23.332520 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:23.332969 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:23.332973 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:23.333616 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:23.333825 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:23.333830 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.334575 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.334576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:23.335522 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:23.335525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:23.335923 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:23.335925 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:23.336062 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:23.336665 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:23.336673 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:23.338360 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:23.340369 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:23.340379 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:23.340382 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:23.340656 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:23.340861 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:23.340861 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:23.340862 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:23.340971 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:23.341248 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:23.341256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:23.341393 (+ 137us) client_negotiation.cc:769] Sending connection context
0805 22:37:23.341501 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 22:37:23.341649 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
I20260805 22:37:23.342450 22736 heartbeater.cc:347] Connected to a master server at 127.19.77.190:36989
I20260805 22:37:23.342578 22736 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:23.342787 22736 heartbeater.cc:511] Master 127.19.77.190:36989 requested a full tablet report, sending...
I20260805 22:37:23.343240 22260 ts_manager.cc:194] Registered new tserver with Master: 74b53acbbea742238407740c8a1dcbfc (127.19.77.131:40197)
I20260805 22:37:23.343636 22260 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:44189
I20260805 22:37:23.350662 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260805 22:37:23.366066 22299 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:23.365051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52678 (local address 127.19.77.190:36989)
0805 22:37:23.365126 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:23.365128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:23.365186 (+ 58us) server_negotiation.cc:407] Connection header received
0805 22:37:23.365250 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:23.365251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:23.365261 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:23.365330 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:23.365972 (+ 642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52678: BlockingRecv error: recv got EOF from 127.0.0.1:52678 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:37:23.366983 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 22323
I20260805 22:37:23.372825 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 22461
I20260805 22:37:23.378680 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 22602
I20260805 22:37:23.384675 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 22226
2026-08-05T22:37:23Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1940 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:23 dist-test-slave-chsk krb5kdc[22748](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:23 dist-test-slave-chsk krb5kdc[22748](info): set up 2 sockets
Aug 05 22:37:23 dist-test-slave-chsk krb5kdc[22748](info): commencing operation
krb5kdc: starting...
W20260805 22:37:24.485951 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260805 22:37:24.716284 19766 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.230s user 0.000s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260805 22:37:24.825911 19766 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.109s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260805 22:37:24.992517 19766 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.166s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/krb5kdc/test-user.keytab.
W20260805 22:37:25.860203 19766 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.868s user 0.000s sys 0.002s
Aug 05 22:37:25 dist-test-slave-chsk krb5kdc[22748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
W20260805 22:37:26.062944 19766 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.19.77.190: real 0.178s user 0.000s sys 0.004s
I20260805 22:37:26.063442 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:41631
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:34129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:41631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:26.153214 22761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:26.153470 22761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:26.153496 22761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:26.154790 22761 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:26.154843 22761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:26.154857 22761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:26.154870 22761 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:26.154882 22761 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:26.156564 22761 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:34129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:41631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:41631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:26.156872 22761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:26.157163 22761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:26.163440 22769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:26.163524 22767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:26.163451 22766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:26.163779 22761 server_base.cc:1034] running on GCE node
I20260805 22:37:26.164130 22761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:26.164530 22761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:26.165726 22761 hybrid_clock.cc:648] HybridClock initialized: now 1785969446165687 us; error 65 us; skew 500 ppm
Aug 05 22:37:26 dist-test-slave-chsk krb5kdc[22748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969446, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:26.168989 22761 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:26.169561 22761 webserver.cc:460] Webserver started at http://127.19.77.190:42373/ using document root <none> and password file <none>
I20260805 22:37:26.169818 22761 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:26.169894 22761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:26.170063 22761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:26.171306 22761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "4534da13995f450c99368e74a67cc260"
format_stamp: "Formatted at 2026-08-05 22:37:26 on dist-test-slave-chsk"
server_key: "8ef17769f8ab4e724b4f9e095e6efcbe"
server_key_iv: "8cd8f8cd927e157eaf9105e233d76ec2"
server_key_version: "encryptionkey@0"
I20260805 22:37:26.171700 22761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "4534da13995f450c99368e74a67cc260"
format_stamp: "Formatted at 2026-08-05 22:37:26 on dist-test-slave-chsk"
server_key: "8ef17769f8ab4e724b4f9e095e6efcbe"
server_key_iv: "8cd8f8cd927e157eaf9105e233d76ec2"
server_key_version: "encryptionkey@0"
I20260805 22:37:26.173383 22761 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:37:26.174315 22776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:26.174536 22761 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:26.174666 22761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "4534da13995f450c99368e74a67cc260"
format_stamp: "Formatted at 2026-08-05 22:37:26 on dist-test-slave-chsk"
server_key: "8ef17769f8ab4e724b4f9e095e6efcbe"
server_key_iv: "8cd8f8cd927e157eaf9105e233d76ec2"
server_key_version: "encryptionkey@0"
I20260805 22:37:26.174754 22761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:26.184032 22761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:26.186197 22761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:26.186391 22761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:26.191272 22761 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:41631
I20260805 22:37:26.191303 22829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:41631 every 8 connection(s)
I20260805 22:37:26.191918 22761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:26.192648 22830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:26.195034 22830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260: Bootstrap starting.
I20260805 22:37:26.195756 22830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:26.196034 22830 log.cc:824] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:26.196772 22830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260: No bootstrap required, opened a new log
I20260805 22:37:26.198460 22830 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4534da13995f450c99368e74a67cc260" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41631 } }
I20260805 22:37:26.198621 22830 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:26.198645 22830 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4534da13995f450c99368e74a67cc260, State: Initialized, Role: FOLLOWER
I20260805 22:37:26.198798 22830 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4534da13995f450c99368e74a67cc260" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41631 } }
I20260805 22:37:26.198889 22830 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:26.198913 22830 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:26.198943 22830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:26.199769 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 22761
I20260805 22:37:26.199911 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:26.200038 22830 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4534da13995f450c99368e74a67cc260" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41631 } }
I20260805 22:37:26.200167 19766 external_mini_cluster.cc:1428] Setting key a4db5d43d28164586165b4237444d694
I20260805 22:37:26.200181 22830 leader_election.cc:302] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4534da13995f450c99368e74a67cc260; no voters:
I20260805 22:37:26.200390 22830 leader_election.cc:288] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:26.200479 22833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:26.200662 22833 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [term 1 LEADER]: Becoming Leader. State: Replica: 4534da13995f450c99368e74a67cc260, State: Running, Role: LEADER
I20260805 22:37:26.200968 22833 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4534da13995f450c99368e74a67cc260" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41631 } }
I20260805 22:37:26.200712 22830 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:26.201782 22834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4534da13995f450c99368e74a67cc260. Latest consensus state: current_term: 1 leader_uuid: "4534da13995f450c99368e74a67cc260" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4534da13995f450c99368e74a67cc260" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41631 } } }
I20260805 22:37:26.201879 22834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:26.202389 22835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4534da13995f450c99368e74a67cc260" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4534da13995f450c99368e74a67cc260" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41631 } } }
I20260805 22:37:26.202575 22835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260 [sys.catalog]: This master's current role is: LEADER
W20260805 22:37:26.203130 22852 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:37:26.203220 22852 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:37:26.203311 22846 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:26.203555 22846 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:26.205392 22846 catalog_manager.cc:1347] Generated new cluster ID: ae7487c1d3614a339c22f65eb0c11faa
I20260805 22:37:26.205502 22846 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:37:26 dist-test-slave-chsk krb5kdc[22748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:26.213398 22837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:26.200918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42342 (local address 127.19.77.190:41631)
0805 22:37:26.201128 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:26.201138 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:26.201178 (+ 40us) server_negotiation.cc:407] Connection header received
0805 22:37:26.201317 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:26.201326 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:26.201396 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:26.201552 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:26.202463 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:26.203741 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:26.204634 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:26.205257 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:26.205381 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:26.208371 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:26.208376 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:26.208376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:26.208391 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:26.211373 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:26.211883 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:26.211887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:26.211887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:26.212007 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:26.212242 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:26.212242 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:26.212242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:26.212562 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:26.212725 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:26.212885 (+ 160us) server_negotiation.cc:299] Negotiation successful
0805 22:37:26.213151 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":84,"threads_started":1}
I20260805 22:37:26.214777 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:37:26.229911 22846 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:26.230762 22846 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:26.235595 22837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:26.230857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42352 (local address 127.19.77.190:41631)
0805 22:37:26.230904 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:26.230906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:26.231112 (+ 206us) server_negotiation.cc:407] Connection header received
0805 22:37:26.231201 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:26.231202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:26.231217 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:26.231287 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:26.231788 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:26.232611 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:26.233690 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:26.234073 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:26.234155 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:26.234995 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:26.234996 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:26.234997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:26.235309 (+ 312us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:26.235330 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:26.235339 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:26.235410 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:26.235474 (+ 64us) server_negotiation.cc:299] Negotiation successful
0805 22:37:26.235505 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":23}
I20260805 22:37:26.239410 22846 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4534da13995f450c99368e74a67cc260: Generated new TSK 0
I20260805 22:37:26.239648 22846 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:37:26.248919 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 22761
2026-08-05T22:37:26Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2862 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:26 dist-test-slave-chsk krb5kdc[22866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:26 dist-test-slave-chsk krb5kdc[22866](info): set up 2 sockets
Aug 05 22:37:26 dist-test-slave-chsk krb5kdc[22866](info): commencing operation
krb5kdc: starting...
W20260805 22:37:27.319444 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:27 dist-test-slave-chsk krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:27.454398 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:42025
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:42025
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:27.540385 22879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:27.540624 22879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:27.540648 22879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:27.541788 22879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:27.541829 22879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:27.541843 22879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:27.541857 22879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:27.541867 22879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:27.543397 22879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:42025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:42025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:27.543617 22879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:27.543803 22879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:27.548928 22884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:27.548990 22885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:27.548985 22887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:27.549237 22879 server_base.cc:1034] running on GCE node
I20260805 22:37:27.549481 22879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:27.549770 22879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:27.550956 22879 hybrid_clock.cc:648] HybridClock initialized: now 1785969447550943 us; error 46 us; skew 500 ppm
Aug 05 22:37:27 dist-test-slave-chsk krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969447, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:27.558221 22879 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:27.558736 22879 webserver.cc:460] Webserver started at http://127.19.77.190:33111/ using document root <none> and password file <none>
I20260805 22:37:27.558981 22879 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:27.559053 22879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:27.559266 22879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:27.560487 22879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "ff97b3b43e1947699ec8b7652a438ee8"
format_stamp: "Formatted at 2026-08-05 22:37:27 on dist-test-slave-chsk"
server_key: "36aacc7be4ad997b93a6a5916be62e74"
server_key_iv: "3ca06de0b2063a6594d5cc16a9e11fde"
server_key_version: "encryptionkey@0"
I20260805 22:37:27.560881 22879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "ff97b3b43e1947699ec8b7652a438ee8"
format_stamp: "Formatted at 2026-08-05 22:37:27 on dist-test-slave-chsk"
server_key: "36aacc7be4ad997b93a6a5916be62e74"
server_key_iv: "3ca06de0b2063a6594d5cc16a9e11fde"
server_key_version: "encryptionkey@0"
I20260805 22:37:27.562359 22879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:27.563261 22894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:27.563480 22879 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:27.563611 22879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "ff97b3b43e1947699ec8b7652a438ee8"
format_stamp: "Formatted at 2026-08-05 22:37:27 on dist-test-slave-chsk"
server_key: "36aacc7be4ad997b93a6a5916be62e74"
server_key_iv: "3ca06de0b2063a6594d5cc16a9e11fde"
server_key_version: "encryptionkey@0"
I20260805 22:37:27.563694 22879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:27.587435 22879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:27.589771 22879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:27.589989 22879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:27.594689 22879 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:42025
I20260805 22:37:27.594731 22946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:42025 every 8 connection(s)
I20260805 22:37:27.595160 22879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:27.596424 22947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:27.599056 22947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8: Bootstrap starting.
I20260805 22:37:27.599879 22947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:27.600198 22947 log.cc:824] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:27.600919 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 22879
I20260805 22:37:27.601070 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:27.601104 22947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8: No bootstrap required, opened a new log
I20260805 22:37:27.601361 19766 external_mini_cluster.cc:1428] Setting key 1c80e651ce87b351b98c8fbb41cc045e
I20260805 22:37:27.603570 22947 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff97b3b43e1947699ec8b7652a438ee8" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42025 } }
I20260805 22:37:27.603801 22947 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:27.603843 22947 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff97b3b43e1947699ec8b7652a438ee8, State: Initialized, Role: FOLLOWER
I20260805 22:37:27.604122 22947 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff97b3b43e1947699ec8b7652a438ee8" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42025 } }
I20260805 22:37:27.604264 22947 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:27.604344 22947 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:27.604451 22947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:27.605901 22947 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff97b3b43e1947699ec8b7652a438ee8" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42025 } }
I20260805 22:37:27.606081 22947 leader_election.cc:302] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff97b3b43e1947699ec8b7652a438ee8; no voters:
I20260805 22:37:27.606374 22947 leader_election.cc:288] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:27.606482 22952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:27.606715 22947 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:27.606758 22952 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [term 1 LEADER]: Becoming Leader. State: Replica: ff97b3b43e1947699ec8b7652a438ee8, State: Running, Role: LEADER
I20260805 22:37:27.606945 22952 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff97b3b43e1947699ec8b7652a438ee8" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42025 } }
I20260805 22:37:27.607493 22954 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff97b3b43e1947699ec8b7652a438ee8. Latest consensus state: current_term: 1 leader_uuid: "ff97b3b43e1947699ec8b7652a438ee8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff97b3b43e1947699ec8b7652a438ee8" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42025 } } }
I20260805 22:37:27.608003 22954 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:27.607877 22953 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff97b3b43e1947699ec8b7652a438ee8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff97b3b43e1947699ec8b7652a438ee8" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42025 } } }
I20260805 22:37:27.608279 22953 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:27.608364 22961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:27.609009 22961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 05 22:37:27 dist-test-slave-chsk krb5kdc[22866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:27.611569 22961 catalog_manager.cc:1347] Generated new cluster ID: b8b4553a10fa44669915f7fd4360aace
I20260805 22:37:27.611635 22961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:27.616659 22951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:27.601999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.19.77.190:42025)
0805 22:37:27.602219 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:27.602230 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:27.602267 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:37:27.603507 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:27.603518 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:27.603593 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:27.603771 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:27.604731 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:27.606686 (+ 1955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:27.607937 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:27.608644 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:27.609151 (+ 507us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:27.611929 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:27.611934 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:27.611934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:27.611947 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:27.614013 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:27.614449 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:27.614453 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:27.614453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:27.615163 (+ 710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:27.615491 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:27.615493 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:27.615493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:27.615903 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:27.616125 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:27.616219 (+ 94us) server_negotiation.cc:299] Negotiation successful
0805 22:37:27.616396 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":105,"threads_started":1}
I20260805 22:37:27.636057 22961 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:27.636649 22961 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:27.642459 22961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff97b3b43e1947699ec8b7652a438ee8: Generated new TSK 0
I20260805 22:37:27.642676 22961 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:37:27.682557 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42025
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:27.804860 22974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:27.805104 22974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:27.805135 22974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:27.806362 22974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:27.806409 22974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:27.806438 22974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:27.808269 22974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:27.808583 22974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:27.808825 22974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:27.815276 22983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:27.815299 22980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:27.815515 22974 server_base.cc:1034] running on GCE node
W20260805 22:37:27.815312 22981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:27.815871 22974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:27.816146 22974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:27.817381 22974 hybrid_clock.cc:648] HybridClock initialized: now 1785969447817358 us; error 71 us; skew 500 ppm
Aug 05 22:37:27 dist-test-slave-chsk krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969447, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:27.820468 22974 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:37:27.820940 22974 webserver.cc:460] Webserver started at http://127.19.77.129:36363/ using document root <none> and password file <none>
I20260805 22:37:27.821237 22974 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:27.821296 22974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:27.821441 22974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:27.822602 22974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "7622d33daef84248894e1ec96ebecd00"
format_stamp: "Formatted at 2026-08-05 22:37:27 on dist-test-slave-chsk"
server_key: "6c6da3b48a3b543b5c94ac99abb4450c"
server_key_iv: "dcbc59795865f90f10791421c0884647"
server_key_version: "encryptionkey@0"
I20260805 22:37:27.822992 22974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "7622d33daef84248894e1ec96ebecd00"
format_stamp: "Formatted at 2026-08-05 22:37:27 on dist-test-slave-chsk"
server_key: "6c6da3b48a3b543b5c94ac99abb4450c"
server_key_iv: "dcbc59795865f90f10791421c0884647"
server_key_version: "encryptionkey@0"
I20260805 22:37:27.824762 22974 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260805 22:37:27.826247 22990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:27.826753 22974 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:27.826871 22974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "7622d33daef84248894e1ec96ebecd00"
format_stamp: "Formatted at 2026-08-05 22:37:27 on dist-test-slave-chsk"
server_key: "6c6da3b48a3b543b5c94ac99abb4450c"
server_key_iv: "dcbc59795865f90f10791421c0884647"
server_key_version: "encryptionkey@0"
I20260805 22:37:27.826984 22974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:27.852442 22974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:27.855515 22974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:27.855690 22974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:27.856014 22974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:27.856390 22974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:27.856451 22974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:27.856485 22974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:27.856515 22974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:27.863309 22974 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:43645
I20260805 22:37:27.863391 23104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:43645 every 8 connection(s)
I20260805 22:37:27.863791 22974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:27.864945 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 22974
I20260805 22:37:27.865061 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:27.865494 19766 external_mini_cluster.cc:1428] Setting key 4647899ea0117e1176be86b3819e6f26
Aug 05 22:37:27 dist-test-slave-chsk krb5kdc[22866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969447, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:37:27.875212 22951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:27.864709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:39037 (local address 127.19.77.190:42025)
0805 22:37:27.864786 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:27.864788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:27.865039 (+ 251us) server_negotiation.cc:407] Connection header received
0805 22:37:27.865706 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:27.865707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:27.865727 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:27.865802 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:27.867205 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:27.867729 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:27.868832 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:27.869065 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:27.869150 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:27.871933 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:27.871934 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:27.871935 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:27.871948 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:27.873570 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:27.874073 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:27.874074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:27.874075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:27.874148 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:27.874430 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:27.874431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:27.874431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:27.874568 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:27.874668 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:27.874978 (+ 310us) server_negotiation.cc:299] Negotiation successful
0805 22:37:27.875088 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260805 22:37:27.875437 23107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:27.864674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42025 (local address 127.19.77.129:39037)
0805 22:37:27.864886 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:27.864927 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:27.865569 (+ 642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:27.865984 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:27.865988 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:27.866824 (+ 836us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:27.867040 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:27.867045 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:27.867850 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:27.867851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:27.868717 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:27.868720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:27.869164 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:27.869166 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:27.869305 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:27.869937 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:27.869947 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:27.871806 (+ 1859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:27.873692 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:27.873703 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:27.873706 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:27.873984 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:27.874231 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:27.874232 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:27.874232 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:27.874357 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:27.874659 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:27.874667 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:27.874830 (+ 163us) client_negotiation.cc:769] Sending connection context
0805 22:37:27.874942 (+ 112us) client_negotiation.cc:240] Negotiation successful
0805 22:37:27.875161 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":105,"threads_started":1}
I20260805 22:37:27.876004 23105 heartbeater.cc:347] Connected to a master server at 127.19.77.190:42025
I20260805 22:37:27.876240 23105 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:27.876478 23105 heartbeater.cc:511] Master 127.19.77.190:42025 requested a full tablet report, sending...
I20260805 22:37:27.877530 22911 ts_manager.cc:194] Registered new tserver with Master: 7622d33daef84248894e1ec96ebecd00 (127.19.77.129:43645)
I20260805 22:37:27.878541 22911 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:39037
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:37:27.898551 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42025
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:27.985741 23111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:27.985984 23111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:27.986013 23111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:27.987322 23111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:27.987373 23111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:27.987404 23111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:27.989064 23111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:27.989357 23111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:27.989646 23111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:27.995077 23119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:27.995105 23117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:27.995251 23116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:27.995523 23111 server_base.cc:1034] running on GCE node
I20260805 22:37:27.995788 23111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:27.996169 23111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:27.997362 23111 hybrid_clock.cc:648] HybridClock initialized: now 1785969447997326 us; error 46 us; skew 500 ppm
Aug 05 22:37:27 dist-test-slave-chsk krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969447, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:28.001000 23111 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:37:28.001662 23111 webserver.cc:460] Webserver started at http://127.19.77.130:46331/ using document root <none> and password file <none>
I20260805 22:37:28.001955 23111 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:28.002070 23111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:28.002241 23111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:28.003530 23111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "b5e11ecc0f4541fda5fc3f9fa4235bf4"
format_stamp: "Formatted at 2026-08-05 22:37:27 on dist-test-slave-chsk"
server_key: "a4c388751fd3a1db4a9490ed358f4100"
server_key_iv: "1359f874c412b40286ae9baaadf5ae60"
server_key_version: "encryptionkey@0"
I20260805 22:37:28.003921 23111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "b5e11ecc0f4541fda5fc3f9fa4235bf4"
format_stamp: "Formatted at 2026-08-05 22:37:27 on dist-test-slave-chsk"
server_key: "a4c388751fd3a1db4a9490ed358f4100"
server_key_iv: "1359f874c412b40286ae9baaadf5ae60"
server_key_version: "encryptionkey@0"
I20260805 22:37:28.005434 23111 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:37:28.006500 23126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:28.006886 23111 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:28.007022 23111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "b5e11ecc0f4541fda5fc3f9fa4235bf4"
format_stamp: "Formatted at 2026-08-05 22:37:27 on dist-test-slave-chsk"
server_key: "a4c388751fd3a1db4a9490ed358f4100"
server_key_iv: "1359f874c412b40286ae9baaadf5ae60"
server_key_version: "encryptionkey@0"
I20260805 22:37:28.007120 23111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:28.020780 23111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:28.023875 23111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:28.024137 23111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:28.024411 23111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:28.024776 23111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:28.024837 23111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:28.024883 23111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:28.024923 23111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:28.032119 23111 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:34813
I20260805 22:37:28.032282 23245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:34813 every 8 connection(s)
I20260805 22:37:28.032721 23111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:28.035840 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 23111
I20260805 22:37:28.035995 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:28.036273 19766 external_mini_cluster.cc:1428] Setting key 8ee9a25f35f98bf160bebac71fa56b2a
Aug 05 22:37:28 dist-test-slave-chsk krb5kdc[22866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969447, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:28.045646 22951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:28.033674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:45681 (local address 127.19.77.190:42025)
0805 22:37:28.033772 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:28.033775 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:28.033982 (+ 207us) server_negotiation.cc:407] Connection header received
0805 22:37:28.034527 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:28.034529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:28.034541 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:28.034619 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:28.035887 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:28.036761 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:28.038042 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:28.038275 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:28.038360 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:28.041781 (+ 3421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:28.041783 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:28.041783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:28.041791 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:28.043672 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:28.044408 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:28.044409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:28.044409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:28.044487 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:28.044847 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:28.044847 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:28.044847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:28.044979 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:28.045039 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:28.045483 (+ 444us) server_negotiation.cc:299] Negotiation successful
0805 22:37:28.045575 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 22:37:28.045912 23248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:28.033625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42025 (local address 127.19.77.130:45681)
0805 22:37:28.033844 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:28.033886 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:28.034393 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:28.034727 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:28.034731 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:28.035483 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:28.035706 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:28.035712 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:28.036903 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:28.036905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:28.037926 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:28.037929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:28.038383 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:28.038384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:28.038520 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:28.039183 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:28.039194 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:28.041619 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:28.043787 (+ 2168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:28.043800 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:28.043808 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:28.044239 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:28.044581 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:28.044583 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:28.044583 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:28.044767 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:28.045067 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:28.045075 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:28.045297 (+ 222us) client_negotiation.cc:769] Sending connection context
0805 22:37:28.045431 (+ 134us) client_negotiation.cc:240] Negotiation successful
0805 22:37:28.045646 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":119,"threads_started":1}
I20260805 22:37:28.046487 23246 heartbeater.cc:347] Connected to a master server at 127.19.77.190:42025
I20260805 22:37:28.046619 23246 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:28.046837 23246 heartbeater.cc:511] Master 127.19.77.190:42025 requested a full tablet report, sending...
I20260805 22:37:28.047362 22911 ts_manager.cc:194] Registered new tserver with Master: b5e11ecc0f4541fda5fc3f9fa4235bf4 (127.19.77.130:34813)
I20260805 22:37:28.047780 22911 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:45681
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:37:28.071640 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42025
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:28.162031 23251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:28.162292 23251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:28.162323 23251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:28.163669 23251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:28.163725 23251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:28.163754 23251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:28.165314 23251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:28.165546 23251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:28.165817 23251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:28.171427 23258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:28.171620 23251 server_base.cc:1034] running on GCE node
W20260805 22:37:28.171411 23257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:28.171409 23260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:28.171978 23251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:28.172247 23251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:28.173408 23251 hybrid_clock.cc:648] HybridClock initialized: now 1785969448173360 us; error 64 us; skew 500 ppm
Aug 05 22:37:28 dist-test-slave-chsk krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969448, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:28.176399 23251 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:37:28.176906 23251 webserver.cc:460] Webserver started at http://127.19.77.131:45077/ using document root <none> and password file <none>
I20260805 22:37:28.177181 23251 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:28.177230 23251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:28.177382 23251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:28.178596 23251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "b245d2ffb2e34d62a7d6585df1af544e"
format_stamp: "Formatted at 2026-08-05 22:37:28 on dist-test-slave-chsk"
server_key: "f40d6bd89224e1e0e6bf95346b7898aa"
server_key_iv: "06cf99acb23be73f0c214d8e767bb2bf"
server_key_version: "encryptionkey@0"
I20260805 22:37:28.178985 23251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "b245d2ffb2e34d62a7d6585df1af544e"
format_stamp: "Formatted at 2026-08-05 22:37:28 on dist-test-slave-chsk"
server_key: "f40d6bd89224e1e0e6bf95346b7898aa"
server_key_iv: "06cf99acb23be73f0c214d8e767bb2bf"
server_key_version: "encryptionkey@0"
I20260805 22:37:28.180537 23251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:28.181737 23268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:28.182236 23251 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:28.182343 23251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "b245d2ffb2e34d62a7d6585df1af544e"
format_stamp: "Formatted at 2026-08-05 22:37:28 on dist-test-slave-chsk"
server_key: "f40d6bd89224e1e0e6bf95346b7898aa"
server_key_iv: "06cf99acb23be73f0c214d8e767bb2bf"
server_key_version: "encryptionkey@0"
I20260805 22:37:28.182479 23251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:28.195592 23251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:28.198366 23251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:28.198513 23251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:28.198848 23251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:28.199309 23251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:28.199370 23251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:28.199409 23251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:28.199436 23251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:28.205848 23251 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:32949
I20260805 22:37:28.205910 23382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:32949 every 8 connection(s)
I20260805 22:37:28.206257 23251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:37:28.208205 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 23251
I20260805 22:37:28.208323 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:28.208513 19766 external_mini_cluster.cc:1428] Setting key de2741f2b80ecbcacc95bf1e4152b280
Aug 05 22:37:28 dist-test-slave-chsk krb5kdc[22866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969448, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:28.218706 22951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:28.207036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:42629 (local address 127.19.77.190:42025)
0805 22:37:28.207282 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:28.207285 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:28.207346 (+ 61us) server_negotiation.cc:407] Connection header received
0805 22:37:28.208096 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:28.208098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:28.208112 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:28.208213 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:28.209662 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:28.210191 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:28.211396 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:28.211611 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:28.211704 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:28.214670 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:28.214672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:28.214672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:28.214681 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:28.216863 (+ 2182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:28.217506 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:28.217508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:28.217508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:28.217583 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:28.217895 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:28.217896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:28.217896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:28.218057 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:28.218143 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:28.218475 (+ 332us) server_negotiation.cc:299] Negotiation successful
0805 22:37:28.218586 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:37:28.219004 23385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:28.207028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42025 (local address 127.19.77.131:42629)
0805 22:37:28.207206 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:28.207255 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:28.207834 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:28.208346 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:28.208351 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:28.209267 (+ 916us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:28.209554 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:28.209566 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:28.210299 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:28.210300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:28.211293 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:28.211296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:28.211717 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:28.211718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:28.211863 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:28.212645 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:28.212659 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:28.214546 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:28.217030 (+ 2484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:28.217057 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:28.217061 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:28.217408 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:28.217670 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:28.217671 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:28.217672 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:28.217821 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:28.218129 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:28.218137 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:28.218322 (+ 185us) client_negotiation.cc:769] Sending connection context
0805 22:37:28.218451 (+ 129us) client_negotiation.cc:240] Negotiation successful
0805 22:37:28.218668 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":98,"threads_started":1}
I20260805 22:37:28.219957 23383 heartbeater.cc:347] Connected to a master server at 127.19.77.190:42025
I20260805 22:37:28.220139 23383 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:28.220396 23383 heartbeater.cc:511] Master 127.19.77.190:42025 requested a full tablet report, sending...
I20260805 22:37:28.220877 22911 ts_manager.cc:194] Registered new tserver with Master: b245d2ffb2e34d62a7d6585df1af544e (127.19.77.131:32949)
I20260805 22:37:28.221318 22911 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:42629
I20260805 22:37:28.232402 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:37:28 dist-test-slave-chsk krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969448, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 05 22:37:28 dist-test-slave-chsk krb5kdc[22866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969448, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:28.264181 22951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:28.254212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46234 (local address 127.19.77.190:42025)
0805 22:37:28.254293 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:28.254295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:28.254308 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:37:28.254394 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:28.254395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:28.254407 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:28.254481 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:28.255465 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:28.255978 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:28.256832 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:28.257107 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:28.257206 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:28.260565 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:28.260568 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:28.260568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:28.260579 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:28.262356 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:28.263062 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:28.263064 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:28.263064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:28.263224 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:28.263541 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:28.263542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:28.263543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:28.263747 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:28.263845 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:28.264017 (+ 172us) server_negotiation.cc:299] Negotiation successful
0805 22:37:28.264098 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260805 22:37:28.264497 22911 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:46234
I20260805 22:37:28.265273 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 22974
I20260805 22:37:28.272236 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 23111
I20260805 22:37:28.277983 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 23251
I20260805 22:37:28.283952 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 22879
2026-08-05T22:37:28Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2037 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:28 dist-test-slave-chsk krb5kdc[23395](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:28 dist-test-slave-chsk krb5kdc[23395](info): set up 2 sockets
Aug 05 22:37:28 dist-test-slave-chsk krb5kdc[23395](info): commencing operation
krb5kdc: starting...
W20260805 22:37:29.378837 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:29 dist-test-slave-chsk krb5kdc[23395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:29.514784 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:39903
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:39903
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:29.598882 23408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:29.599195 23408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:29.599242 23408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:29.600490 23408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:29.600567 23408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:29.600593 23408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:29.600615 23408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:29.600644 23408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:29.602252 23408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:39903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:39903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:29.602551 23408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:29.602798 23408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:29.608063 23416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:29.608093 23414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:29.608309 23408 server_base.cc:1034] running on GCE node
W20260805 22:37:29.608083 23413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:29.608659 23408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:29.608927 23408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:29.610071 23408 hybrid_clock.cc:648] HybridClock initialized: now 1785969449610063 us; error 52 us; skew 500 ppm
Aug 05 22:37:29 dist-test-slave-chsk krb5kdc[23395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969449, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:29.612701 23408 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:29.613211 23408 webserver.cc:460] Webserver started at http://127.19.77.190:33413/ using document root <none> and password file <none>
I20260805 22:37:29.613452 23408 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:29.613499 23408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:29.613637 23408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:29.614779 23408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "aae2c8be705f4311a11cf2f460ab72f3"
format_stamp: "Formatted at 2026-08-05 22:37:29 on dist-test-slave-chsk"
server_key: "096558120e992897f41770da0d8c0644"
server_key_iv: "67e384b43c4545739f60ff4cabaf3216"
server_key_version: "encryptionkey@0"
I20260805 22:37:29.615186 23408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "aae2c8be705f4311a11cf2f460ab72f3"
format_stamp: "Formatted at 2026-08-05 22:37:29 on dist-test-slave-chsk"
server_key: "096558120e992897f41770da0d8c0644"
server_key_iv: "67e384b43c4545739f60ff4cabaf3216"
server_key_version: "encryptionkey@0"
I20260805 22:37:29.616681 23408 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:29.617619 23423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:29.617833 23408 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:29.617939 23408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "aae2c8be705f4311a11cf2f460ab72f3"
format_stamp: "Formatted at 2026-08-05 22:37:29 on dist-test-slave-chsk"
server_key: "096558120e992897f41770da0d8c0644"
server_key_iv: "67e384b43c4545739f60ff4cabaf3216"
server_key_version: "encryptionkey@0"
I20260805 22:37:29.618031 23408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:29.628460 23408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:29.630817 23408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:29.631048 23408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:29.635852 23408 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:39903
I20260805 22:37:29.635923 23476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:39903 every 8 connection(s)
I20260805 22:37:29.636489 23408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:29.637200 23477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:29.639623 23477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3: Bootstrap starting.
I20260805 22:37:29.640336 23477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:29.640502 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 23408
I20260805 22:37:29.640636 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:29.640736 23477 log.cc:824] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:29.640841 19766 external_mini_cluster.cc:1428] Setting key 234f723824b302bdde3d5af027a62c6e
I20260805 22:37:29.641718 23477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3: No bootstrap required, opened a new log
I20260805 22:37:29.644610 23477 raft_consensus.cc:348] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae2c8be705f4311a11cf2f460ab72f3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39903 } }
I20260805 22:37:29.644794 23477 raft_consensus.cc:374] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:29.644837 23477 raft_consensus.cc:729] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae2c8be705f4311a11cf2f460ab72f3, State: Initialized, Role: FOLLOWER
I20260805 22:37:29.645061 23477 consensus_queue.cc:260] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae2c8be705f4311a11cf2f460ab72f3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39903 } }
I20260805 22:37:29.645187 23477 raft_consensus.cc:388] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:29.645236 23477 raft_consensus.cc:482] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:29.645287 23477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:29.645985 23477 raft_consensus.cc:504] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae2c8be705f4311a11cf2f460ab72f3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39903 } }
I20260805 22:37:29.646098 23477 leader_election.cc:302] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aae2c8be705f4311a11cf2f460ab72f3; no voters:
I20260805 22:37:29.646270 23477 leader_election.cc:288] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:29.646351 23482 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:29.646549 23477 sys_catalog.cc:564] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:29.646585 23482 raft_consensus.cc:686] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [term 1 LEADER]: Becoming Leader. State: Replica: aae2c8be705f4311a11cf2f460ab72f3, State: Running, Role: LEADER
I20260805 22:37:29.646804 23482 consensus_queue.cc:237] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae2c8be705f4311a11cf2f460ab72f3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39903 } }
I20260805 22:37:29.647236 23484 sys_catalog.cc:455] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aae2c8be705f4311a11cf2f460ab72f3. Latest consensus state: current_term: 1 leader_uuid: "aae2c8be705f4311a11cf2f460ab72f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae2c8be705f4311a11cf2f460ab72f3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39903 } } }
I20260805 22:37:29.647316 23484 sys_catalog.cc:458] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:29.647715 23483 sys_catalog.cc:455] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aae2c8be705f4311a11cf2f460ab72f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae2c8be705f4311a11cf2f460ab72f3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39903 } } }
I20260805 22:37:29.647782 23483 sys_catalog.cc:458] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:29.648233 23486 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:29.648810 23486 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 05 22:37:29 dist-test-slave-chsk krb5kdc[23395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:29.650555 23486 catalog_manager.cc:1347] Generated new cluster ID: 1db5ee96c2554cc1a9372ae01b025d13
I20260805 22:37:29.650612 23486 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:29.654152 23481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:29.641504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39310 (local address 127.19.77.190:39903)
0805 22:37:29.641715 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:29.641724 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:29.641760 (+ 36us) server_negotiation.cc:407] Connection header received
0805 22:37:29.642344 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:29.642353 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:29.642418 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:29.642596 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:29.643343 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:29.644800 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:29.645748 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:29.646396 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:29.646879 (+ 483us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:29.649804 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:29.649808 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:29.649808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:29.649821 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:29.652041 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:29.652457 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:29.652459 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:29.652460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:29.652555 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:29.652731 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:29.652732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:29.652732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:29.653013 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:29.653530 (+ 517us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:29.653625 (+ 95us) server_negotiation.cc:299] Negotiation successful
0805 22:37:29.653762 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":94,"threads_started":1}
I20260805 22:37:29.673573 23486 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:29.674176 23486 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:29.678591 23486 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aae2c8be705f4311a11cf2f460ab72f3: Generated new TSK 0
I20260805 22:37:29.678817 23486 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:37:29.723945 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:39903
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:29.831887 23505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:29.832135 23505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:29.832162 23505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:29.833348 23505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:29.833390 23505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:29.833418 23505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:29.834993 23505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:39903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:29.835304 23505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:29.835516 23505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:29.841086 23511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:29.841087 23512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:29.841094 23514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:29.841284 23505 server_base.cc:1034] running on GCE node
I20260805 22:37:29.841637 23505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:29.841907 23505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:29.843087 23505 hybrid_clock.cc:648] HybridClock initialized: now 1785969449843071 us; error 37 us; skew 500 ppm
Aug 05 22:37:29 dist-test-slave-chsk krb5kdc[23395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969449, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:29.846556 23505 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:37:29.847462 23505 webserver.cc:460] Webserver started at http://127.19.77.129:44643/ using document root <none> and password file <none>
I20260805 22:37:29.847836 23505 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:29.847918 23505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:29.848107 23505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:29.849552 23505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "f1e799335b4543f3a7bd9430924414ce"
format_stamp: "Formatted at 2026-08-05 22:37:29 on dist-test-slave-chsk"
server_key: "4ef033058e23ae50b627bddc22557b01"
server_key_iv: "6672eb15440194b3d816cf46b84f5baa"
server_key_version: "encryptionkey@0"
I20260805 22:37:29.849936 23505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "f1e799335b4543f3a7bd9430924414ce"
format_stamp: "Formatted at 2026-08-05 22:37:29 on dist-test-slave-chsk"
server_key: "4ef033058e23ae50b627bddc22557b01"
server_key_iv: "6672eb15440194b3d816cf46b84f5baa"
server_key_version: "encryptionkey@0"
I20260805 22:37:29.852125 23505 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260805 22:37:29.853263 23521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:29.853569 23505 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:29.853683 23505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "f1e799335b4543f3a7bd9430924414ce"
format_stamp: "Formatted at 2026-08-05 22:37:29 on dist-test-slave-chsk"
server_key: "4ef033058e23ae50b627bddc22557b01"
server_key_iv: "6672eb15440194b3d816cf46b84f5baa"
server_key_version: "encryptionkey@0"
I20260805 22:37:29.853776 23505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:29.875397 23505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:29.877854 23505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:29.878022 23505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:29.878338 23505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:29.878679 23505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:29.878736 23505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:29.878779 23505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:29.878808 23505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:29.885651 23505 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:46231
I20260805 22:37:29.885697 23636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:46231 every 8 connection(s)
I20260805 22:37:29.886062 23505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:29.891812 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 23505
I20260805 22:37:29.891953 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:29.892184 19766 external_mini_cluster.cc:1428] Setting key 64da192fa409847a9c0d97f6087f512b
Aug 05 22:37:29 dist-test-slave-chsk krb5kdc[23395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969449, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:29.897094 23481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:29.886953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:60515 (local address 127.19.77.190:39903)
0805 22:37:29.887085 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:29.887087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:29.887279 (+ 192us) server_negotiation.cc:407] Connection header received
0805 22:37:29.888320 (+ 1041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:29.888321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:29.888333 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:29.888416 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:29.889121 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:29.889641 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:29.890683 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:29.890893 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:29.890962 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:29.893640 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:29.893641 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:29.893642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:29.893652 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:29.895333 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:29.895990 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:29.895991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:29.895991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:29.896057 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:29.896374 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:29.896374 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:29.896374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:29.896498 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:29.896569 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:29.896920 (+ 351us) server_negotiation.cc:299] Negotiation successful
0805 22:37:29.897009 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260805 22:37:29.897498 23639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:29.886867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:39903 (local address 127.19.77.129:60515)
0805 22:37:29.887077 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:29.887123 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:29.888187 (+ 1064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:29.888505 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:29.888508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:29.888812 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:29.889021 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:29.889026 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:29.889737 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:29.889738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:29.890570 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:29.890572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:29.890985 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:29.890986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:29.891095 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:29.891747 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:29.891760 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:29.893532 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:29.895427 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:29.895437 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:29.895440 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:29.895841 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:29.896140 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:29.896141 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:29.896141 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:29.896302 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:29.896569 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:29.896576 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:29.896775 (+ 199us) client_negotiation.cc:769] Sending connection context
0805 22:37:29.896898 (+ 123us) client_negotiation.cc:240] Negotiation successful
0805 22:37:29.897100 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":102,"threads_started":1}
I20260805 22:37:29.898164 23637 heartbeater.cc:347] Connected to a master server at 127.19.77.190:39903
I20260805 22:37:29.898319 23637 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:29.898554 23637 heartbeater.cc:511] Master 127.19.77.190:39903 requested a full tablet report, sending...
I20260805 22:37:29.899251 23440 ts_manager.cc:194] Registered new tserver with Master: f1e799335b4543f3a7bd9430924414ce (127.19.77.129:46231)
I20260805 22:37:29.900274 23440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:60515
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:37:29.922717 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:39903
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:30.017925 23642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:30.018164 23642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:30.018190 23642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:30.019606 23642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:30.019663 23642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:30.019693 23642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:30.021363 23642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:39903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:30.021637 23642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:30.021894 23642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:30.028779 23650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:30.028918 23648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:30.028779 23647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:30.029151 23642 server_base.cc:1034] running on GCE node
I20260805 22:37:30.029532 23642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:30.029873 23642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:30.031112 23642 hybrid_clock.cc:648] HybridClock initialized: now 1785969450031085 us; error 41 us; skew 500 ppm
Aug 05 22:37:30 dist-test-slave-chsk krb5kdc[23395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969450, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:30.034261 23642 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:37:30.034806 23642 webserver.cc:460] Webserver started at http://127.19.77.130:40061/ using document root <none> and password file <none>
I20260805 22:37:30.035069 23642 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:30.035143 23642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:30.035328 23642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:30.036377 23642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "58cfb206665d46d4b5a8215858c02906"
format_stamp: "Formatted at 2026-08-05 22:37:30 on dist-test-slave-chsk"
server_key: "31a44a6151e1931ef380ef8dd73adcc4"
server_key_iv: "37894f2886dfbd20f9430bfa67467343"
server_key_version: "encryptionkey@0"
I20260805 22:37:30.036695 23642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "58cfb206665d46d4b5a8215858c02906"
format_stamp: "Formatted at 2026-08-05 22:37:30 on dist-test-slave-chsk"
server_key: "31a44a6151e1931ef380ef8dd73adcc4"
server_key_iv: "37894f2886dfbd20f9430bfa67467343"
server_key_version: "encryptionkey@0"
I20260805 22:37:30.038064 23642 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:37:30.038887 23658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:30.039120 23642 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:30.039250 23642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "58cfb206665d46d4b5a8215858c02906"
format_stamp: "Formatted at 2026-08-05 22:37:30 on dist-test-slave-chsk"
server_key: "31a44a6151e1931ef380ef8dd73adcc4"
server_key_iv: "37894f2886dfbd20f9430bfa67467343"
server_key_version: "encryptionkey@0"
I20260805 22:37:30.039312 23642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:30.049769 23642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:30.052351 23642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:30.052480 23642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:30.052695 23642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:30.053042 23642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:30.053083 23642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:30.053107 23642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:30.053119 23642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:30.059826 23642 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:35353
I20260805 22:37:30.059868 23775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:35353 every 8 connection(s)
I20260805 22:37:30.060249 23642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:37:30 dist-test-slave-chsk krb5kdc[23395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969450, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:30.069401 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 23642
I20260805 22:37:30.069562 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:30.069778 19766 external_mini_cluster.cc:1428] Setting key 1b8e604b7bcbb934d9aac5a7fd10f6ee
I20260805 22:37:30.072096 23481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:30.061068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:48621 (local address 127.19.77.190:39903)
0805 22:37:30.061382 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:30.061392 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:30.061646 (+ 254us) server_negotiation.cc:407] Connection header received
0805 22:37:30.062690 (+ 1044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:30.062691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:30.062704 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:30.062769 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:30.063615 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.064231 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.065422 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.065672 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.065747 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:30.068618 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:30.068619 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:30.068620 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:30.068627 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:30.070442 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:30.071025 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:30.071026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:30.071026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:30.071081 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:30.071423 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:30.071423 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:30.071424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:30.071537 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:30.071592 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:30.071957 (+ 365us) server_negotiation.cc:299] Negotiation successful
0805 22:37:30.072030 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260805 22:37:30.072419 23778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:30.061024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:39903 (local address 127.19.77.130:48621)
0805 22:37:30.061505 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:30.061548 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:30.062547 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:30.062848 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:30.062851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:30.063260 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:30.063474 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:30.063479 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.064384 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.064385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:30.065286 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:30.065289 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.065832 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.065833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:30.065967 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:30.066571 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:30.066581 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:30.068494 (+ 1913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:30.070540 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:30.070551 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:30.070555 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:30.070938 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:30.071189 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:30.071190 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:30.071191 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:30.071352 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:30.071607 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:30.071613 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:30.071797 (+ 184us) client_negotiation.cc:769] Sending connection context
0805 22:37:30.071911 (+ 114us) client_negotiation.cc:240] Negotiation successful
0805 22:37:30.072117 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":371,"threads_started":1}
I20260805 22:37:30.072958 23776 heartbeater.cc:347] Connected to a master server at 127.19.77.190:39903
I20260805 22:37:30.073084 23776 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:30.073292 23776 heartbeater.cc:511] Master 127.19.77.190:39903 requested a full tablet report, sending...
I20260805 22:37:30.073683 23440 ts_manager.cc:194] Registered new tserver with Master: 58cfb206665d46d4b5a8215858c02906 (127.19.77.130:35353)
I20260805 22:37:30.074272 23440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:48621
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:37:30.103307 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:39903
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:30.194566 23781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:30.194806 23781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:30.194835 23781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:30.196249 23781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:30.196306 23781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:30.196336 23781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:30.198025 23781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:39903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:30.198325 23781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:30.198612 23781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:30.204223 23787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:30.204264 23790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:30.204517 23781 server_base.cc:1034] running on GCE node
W20260805 22:37:30.204319 23786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:30.205035 23781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:30.205417 23781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:30.206626 23781 hybrid_clock.cc:648] HybridClock initialized: now 1785969450206588 us; error 63 us; skew 500 ppm
Aug 05 22:37:30 dist-test-slave-chsk krb5kdc[23395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969450, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:30.210376 23781 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:37:30.210911 23781 webserver.cc:460] Webserver started at http://127.19.77.131:38519/ using document root <none> and password file <none>
I20260805 22:37:30.211252 23781 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:30.211308 23781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:30.211452 23781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:30.212674 23781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "5c1e27def6df4a55aaa3156c25904b60"
format_stamp: "Formatted at 2026-08-05 22:37:30 on dist-test-slave-chsk"
server_key: "f0107895b37019d04cb048223a34375f"
server_key_iv: "c27265b8b9ee920b2da97d58929679c7"
server_key_version: "encryptionkey@0"
I20260805 22:37:30.213060 23781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "5c1e27def6df4a55aaa3156c25904b60"
format_stamp: "Formatted at 2026-08-05 22:37:30 on dist-test-slave-chsk"
server_key: "f0107895b37019d04cb048223a34375f"
server_key_iv: "c27265b8b9ee920b2da97d58929679c7"
server_key_version: "encryptionkey@0"
I20260805 22:37:30.214684 23781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:30.215930 23797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:30.216338 23781 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:30.216434 23781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "5c1e27def6df4a55aaa3156c25904b60"
format_stamp: "Formatted at 2026-08-05 22:37:30 on dist-test-slave-chsk"
server_key: "f0107895b37019d04cb048223a34375f"
server_key_iv: "c27265b8b9ee920b2da97d58929679c7"
server_key_version: "encryptionkey@0"
I20260805 22:37:30.216555 23781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:30.248769 23781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:30.251350 23781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:30.251529 23781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:30.251813 23781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:30.252156 23781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:30.252214 23781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:30.252251 23781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:30.252277 23781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:30.259050 23781 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:34945
I20260805 22:37:30.259093 23914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:34945 every 8 connection(s)
I20260805 22:37:30.259529 23781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:37:30.260296 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 23781
I20260805 22:37:30.260401 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:30.260619 19766 external_mini_cluster.cc:1428] Setting key da3a52bf995a33fa669a6208101e1d75
Aug 05 22:37:30 dist-test-slave-chsk krb5kdc[23395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969450, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:30.271003 23481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:30.260468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:50759 (local address 127.19.77.190:39903)
0805 22:37:30.260526 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:30.260529 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:30.260746 (+ 217us) server_negotiation.cc:407] Connection header received
0805 22:37:30.262034 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:30.262035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:30.262048 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:30.262104 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:30.262831 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.263425 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.264485 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.264676 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.264755 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:30.267634 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:30.267636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:30.267636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:30.267646 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:30.269364 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:30.269942 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:30.269943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:30.269944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:30.270016 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:30.270290 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:30.270291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:30.270292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:30.270424 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:30.270512 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:30.270806 (+ 294us) server_negotiation.cc:299] Negotiation successful
0805 22:37:30.270899 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:37:30.271276 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:30.260390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:39903 (local address 127.19.77.131:50759)
0805 22:37:30.260597 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:30.260637 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:30.261898 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:30.262192 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:30.262197 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:30.262505 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:30.262707 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:30.262712 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.263531 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.263532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:30.264360 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:30.264363 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.264764 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.264765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:30.264900 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:30.265511 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:30.265528 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:30.267420 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:30.269552 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:30.269561 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:30.269564 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:30.269852 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:30.270090 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:30.270091 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:30.270091 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:30.270215 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:30.270502 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:30.270509 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:30.270662 (+ 153us) client_negotiation.cc:769] Sending connection context
0805 22:37:30.270783 (+ 121us) client_negotiation.cc:240] Negotiation successful
0805 22:37:30.270975 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":104,"threads_started":1}
I20260805 22:37:30.271883 23915 heartbeater.cc:347] Connected to a master server at 127.19.77.190:39903
I20260805 22:37:30.272004 23915 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:30.272251 23915 heartbeater.cc:511] Master 127.19.77.190:39903 requested a full tablet report, sending...
I20260805 22:37:30.272620 23440 ts_manager.cc:194] Registered new tserver with Master: 5c1e27def6df4a55aaa3156c25904b60 (127.19.77.131:34945)
I20260805 22:37:30.273011 23440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:50759
I20260805 22:37:30.284132 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:37:30 dist-test-slave-chsk krb5kdc[23395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:37:30 dist-test-slave-chsk krb5kdc[23395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:37:30.311839 23922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:30.302819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50524 (local address 127.19.77.129:46231)
0805 22:37:30.303056 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:30.303063 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:30.303077 (+ 14us) server_negotiation.cc:407] Connection header received
0805 22:37:30.303116 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:30.303119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:30.303167 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:30.303290 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:30.303933 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.304695 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.305446 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.305782 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.305843 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:30.308490 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:30.308501 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:30.308501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:30.308509 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:30.310299 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:30.310660 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:30.310663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:30.310663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:30.310771 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:30.311010 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:30.311012 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:30.311012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:30.311271 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:30.311395 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:30.311675 (+ 280us) server_negotiation.cc:299] Negotiation successful
0805 22:37:30.311753 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":112,"threads_started":1}
Aug 05 22:37:30 dist-test-slave-chsk krb5kdc[23395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:30.322679 23481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:30.313599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39320 (local address 127.19.77.190:39903)
0805 22:37:30.313692 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:30.313694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:30.313705 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:30.313756 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:30.313757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:30.313766 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:30.313832 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:30.314512 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.315032 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.315783 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:30.315981 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:30.316074 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:30.318903 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:30.318905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:30.318905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:30.318913 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:30.320931 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:30.321654 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:30.321655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:30.321655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:30.321716 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:30.321911 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:30.321911 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:30.321912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:30.322103 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:30.322191 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:30.322504 (+ 313us) server_negotiation.cc:299] Negotiation successful
0805 22:37:30.322588 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260805 22:37:30.323046 23440 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39320
I20260805 22:37:30.323841 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 23505
I20260805 22:37:30.331826 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 23642
I20260805 22:37:30.338866 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 23781
I20260805 22:37:30.344489 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 23408
2026-08-05T22:37:30Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2059 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:30 dist-test-slave-chsk krb5kdc[23927](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:30 dist-test-slave-chsk krb5kdc[23927](info): set up 2 sockets
Aug 05 22:37:30 dist-test-slave-chsk krb5kdc[23927](info): commencing operation
krb5kdc: starting...
W20260805 22:37:31.410841 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:31 dist-test-slave-chsk krb5kdc[23927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:31.544260 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:33245
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:33245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:31.629102 23940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:31.629365 23940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:31.629391 23940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:31.630645 23940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:31.630698 23940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:31.630713 23940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:31.630726 23940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:31.630739 23940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:31.632414 23940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:33245
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:33245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:31.632706 23940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:31.632957 23940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:31.638274 23948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:31.638278 23945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:31.638306 23940 server_base.cc:1034] running on GCE node
W20260805 22:37:31.638274 23946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:31.638774 23940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:31.639183 23940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:31.640378 23940 hybrid_clock.cc:648] HybridClock initialized: now 1785969451640363 us; error 48 us; skew 500 ppm
Aug 05 22:37:31 dist-test-slave-chsk krb5kdc[23927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969451, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:31.642990 23940 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:31.643458 23940 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:31.643539 23940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:31.643684 23940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:31.644806 23940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "a9806703b1d441729af11fe6efe37005"
format_stamp: "Formatted at 2026-08-05 22:37:31 on dist-test-slave-chsk"
server_key: "f26e5ea78f3d31515f7d663650773b7f"
server_key_iv: "b16dc0a7aa9bbd652f681279f12849ae"
server_key_version: "encryptionkey@0"
I20260805 22:37:31.645205 23940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "a9806703b1d441729af11fe6efe37005"
format_stamp: "Formatted at 2026-08-05 22:37:31 on dist-test-slave-chsk"
server_key: "f26e5ea78f3d31515f7d663650773b7f"
server_key_iv: "b16dc0a7aa9bbd652f681279f12849ae"
server_key_version: "encryptionkey@0"
I20260805 22:37:31.646605 23940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:37:31.647869 23955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:31.648144 23940 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:31.648262 23940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "a9806703b1d441729af11fe6efe37005"
format_stamp: "Formatted at 2026-08-05 22:37:31 on dist-test-slave-chsk"
server_key: "f26e5ea78f3d31515f7d663650773b7f"
server_key_iv: "b16dc0a7aa9bbd652f681279f12849ae"
server_key_version: "encryptionkey@0"
I20260805 22:37:31.648357 23940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:31.670647 23940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:31.672849 23940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:31.672979 23940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:31.677592 23940 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:33245
I20260805 22:37:31.677613 24008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:33245 every 8 connection(s)
I20260805 22:37:31.678128 23940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:31.679633 24009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:31.680858 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 23940
I20260805 22:37:31.680992 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:31.681195 19766 external_mini_cluster.cc:1428] Setting key d844748da5171b7b75574c1c7a5d1155
I20260805 22:37:31.682389 24009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005: Bootstrap starting.
I20260805 22:37:31.683019 24009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:31.683372 24009 log.cc:824] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:31.684113 24009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005: No bootstrap required, opened a new log
I20260805 22:37:31.685858 24009 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9806703b1d441729af11fe6efe37005" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 33245 } }
I20260805 22:37:31.686033 24009 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:31.686086 24009 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9806703b1d441729af11fe6efe37005, State: Initialized, Role: FOLLOWER
I20260805 22:37:31.686213 24009 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9806703b1d441729af11fe6efe37005" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 33245 } }
I20260805 22:37:31.686272 24009 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:31.686363 24009 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:31.686441 24009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:31.687301 24009 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9806703b1d441729af11fe6efe37005" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 33245 } }
I20260805 22:37:31.687422 24009 leader_election.cc:302] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9806703b1d441729af11fe6efe37005; no voters:
I20260805 22:37:31.687615 24009 leader_election.cc:288] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:31.687672 24014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:31.687871 24014 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [term 1 LEADER]: Becoming Leader. State: Replica: a9806703b1d441729af11fe6efe37005, State: Running, Role: LEADER
I20260805 22:37:31.687952 24009 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:31.688016 24014 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9806703b1d441729af11fe6efe37005" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 33245 } }
Aug 05 22:37:31 dist-test-slave-chsk krb5kdc[23927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:31.688374 24014 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9806703b1d441729af11fe6efe37005. Latest consensus state: current_term: 1 leader_uuid: "a9806703b1d441729af11fe6efe37005" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9806703b1d441729af11fe6efe37005" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 33245 } } }
I20260805 22:37:31.688457 24014 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:31.688385 24016 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9806703b1d441729af11fe6efe37005" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9806703b1d441729af11fe6efe37005" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 33245 } } }
I20260805 22:37:31.688503 24016 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:31.689673 24021 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:31.690148 24021 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:31.691810 24021 catalog_manager.cc:1347] Generated new cluster ID: 0ed3e6539d98459ab145efe47364d848
I20260805 22:37:31.691866 24021 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:31.693383 24012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:31.681784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46384 (local address 127.19.77.190:33245)
0805 22:37:31.681991 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:31.682001 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:31.682037 (+ 36us) server_negotiation.cc:407] Connection header received
0805 22:37:31.682530 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:31.682539 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:31.682599 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:31.682743 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:31.683491 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:31.684469 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:31.685273 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:31.685684 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:31.685803 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:31.688892 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:31.688898 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:31.688898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:31.688911 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:31.691210 (+ 2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:31.691672 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:31.691675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:31.691675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:31.691779 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:31.691997 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:31.691997 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:31.691998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:31.692301 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:31.692945 (+ 644us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:31.693028 (+ 83us) server_negotiation.cc:299] Negotiation successful
0805 22:37:31.693175 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":87,"threads_started":1}
I20260805 22:37:31.705327 24021 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:31.705911 24021 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:31.709177 24021 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005: Generated new TSK 0
I20260805 22:37:31.709398 24021 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:37:31.746953 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:33245
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:31.847908 24036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:31.848135 24036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:31.848162 24036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:31.849378 24036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:31.849426 24036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:31.849453 24036 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:31.851075 24036 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:33245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:31.851388 24036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:31.851709 24036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:31.857244 24042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:31.857236 24041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:31.857242 24044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:31.857431 24036 server_base.cc:1034] running on GCE node
I20260805 22:37:31.857715 24036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:31.858021 24036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:31.859259 24036 hybrid_clock.cc:648] HybridClock initialized: now 1785969451859250 us; error 37 us; skew 500 ppm
Aug 05 22:37:31 dist-test-slave-chsk krb5kdc[23927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969451, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:31.861851 24036 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:37:31.862300 24036 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:31.862378 24036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:31.862532 24036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:31.863694 24036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "8411478f887c4fd98344d55e368a61b2"
format_stamp: "Formatted at 2026-08-05 22:37:31 on dist-test-slave-chsk"
server_key: "c89d5c6f5cfcc2644eb715b8c07a81ef"
server_key_iv: "211f0b730fe7b1827b1fe0107d46fd0e"
server_key_version: "encryptionkey@0"
I20260805 22:37:31.864064 24036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "8411478f887c4fd98344d55e368a61b2"
format_stamp: "Formatted at 2026-08-05 22:37:31 on dist-test-slave-chsk"
server_key: "c89d5c6f5cfcc2644eb715b8c07a81ef"
server_key_iv: "211f0b730fe7b1827b1fe0107d46fd0e"
server_key_version: "encryptionkey@0"
I20260805 22:37:31.865409 24036 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:37:31.866145 24050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:31.866335 24036 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:31.866444 24036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "8411478f887c4fd98344d55e368a61b2"
format_stamp: "Formatted at 2026-08-05 22:37:31 on dist-test-slave-chsk"
server_key: "c89d5c6f5cfcc2644eb715b8c07a81ef"
server_key_iv: "211f0b730fe7b1827b1fe0107d46fd0e"
server_key_version: "encryptionkey@0"
I20260805 22:37:31.866520 24036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:31.891115 24036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:31.893282 24036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:31.893466 24036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:31.893748 24036 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:31.894089 24036 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:31.894147 24036 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:31.894193 24036 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:31.894220 24036 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:31.900731 24036 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:40211
I20260805 22:37:31.900779 24166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:40211 every 8 connection(s)
I20260805 22:37:31.901110 24036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:31.904580 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 24036
I20260805 22:37:31.904721 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:31.904913 19766 external_mini_cluster.cc:1428] Setting key e2b7764576d6e84e649d3f92ea50abc5
Aug 05 22:37:31 dist-test-slave-chsk krb5kdc[23927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969451, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:31.912156 24169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:31.901899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:33245 (local address 127.19.77.129:34561)
0805 22:37:31.902087 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:31.902132 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:31.902619 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:31.902883 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:31.902886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:31.903264 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:31.903779 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:31.903784 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:31.904573 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:31.904574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:31.905884 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:31.905888 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:31.906274 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:31.906275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:31.906431 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:31.907056 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:31.907067 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:31.908732 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:31.910681 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:31.910689 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:31.910691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:31.910920 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:31.911188 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:31.911189 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:31.911189 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:31.911305 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:31.911635 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:31.911640 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:31.911766 (+ 126us) client_negotiation.cc:769] Sending connection context
0805 22:37:31.911846 (+ 80us) client_negotiation.cc:240] Negotiation successful
0805 22:37:31.911976 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":103,"threads_started":1}
I20260805 22:37:31.912165 24012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:31.901945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:34561 (local address 127.19.77.190:33245)
0805 22:37:31.902013 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:31.902015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:31.902229 (+ 214us) server_negotiation.cc:407] Connection header received
0805 22:37:31.902748 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:31.902749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:31.902761 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:31.902824 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:31.903888 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:31.904434 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:31.905974 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:31.906174 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:31.906236 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:31.908842 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:31.908844 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:31.908844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:31.908853 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:31.910585 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:31.911003 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:31.911005 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:31.911005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:31.911072 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:31.911379 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:31.911381 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:31.911381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:31.911559 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:31.911642 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:31.911916 (+ 274us) server_negotiation.cc:299] Negotiation successful
0805 22:37:31.912023 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:37:31.912837 24167 heartbeater.cc:347] Connected to a master server at 127.19.77.190:33245
I20260805 22:37:31.912961 24167 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:31.913152 24167 heartbeater.cc:511] Master 127.19.77.190:33245 requested a full tablet report, sending...
I20260805 22:37:31.913763 23972 ts_manager.cc:194] Registered new tserver with Master: 8411478f887c4fd98344d55e368a61b2 (127.19.77.129:40211)
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:37:31.914767 23972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:34561
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:37:31.934592 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:33245
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:32.019096 24172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:32.019402 24172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:32.019443 24172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:32.020653 24172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:32.020732 24172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:32.020779 24172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:32.022397 24172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:33245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:32.022691 24172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:32.022938 24172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:32.028376 24177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:32.028607 24178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:32.028376 24180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:32.028852 24172 server_base.cc:1034] running on GCE node
I20260805 22:37:32.029093 24172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:32.029314 24172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:32.030452 24172 hybrid_clock.cc:648] HybridClock initialized: now 1785969452030441 us; error 37 us; skew 500 ppm
Aug 05 22:37:32 dist-test-slave-chsk krb5kdc[23927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969452, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:32.033231 24172 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:37:32.033643 24172 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:32.033696 24172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:32.033875 24172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:32.035283 24172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "90ca9f71645f4f89875e9316e7387ae8"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "8745d1706563c1feec5c9cc8b55bafa2"
server_key_iv: "d52048c68968245efdb8df55cdc0ed95"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.035670 24172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "90ca9f71645f4f89875e9316e7387ae8"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "8745d1706563c1feec5c9cc8b55bafa2"
server_key_iv: "d52048c68968245efdb8df55cdc0ed95"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.037096 24172 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:37:32.037951 24186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.038148 24172 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:32.038254 24172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "90ca9f71645f4f89875e9316e7387ae8"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "8745d1706563c1feec5c9cc8b55bafa2"
server_key_iv: "d52048c68968245efdb8df55cdc0ed95"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.038339 24172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:32.060871 24172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:32.063298 24172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:32.063495 24172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:32.063763 24172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:32.064118 24172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:32.064183 24172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.064231 24172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:32.064255 24172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.071019 24172 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:46703
I20260805 22:37:32.071060 24303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:46703 every 8 connection(s)
I20260805 22:37:32.071408 24172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:37:32 dist-test-slave-chsk krb5kdc[23927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969452, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:32.081007 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 24172
I20260805 22:37:32.081156 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:32.081374 19766 external_mini_cluster.cc:1428] Setting key ad6ffb5a4f49ebd4c676b6e29f718588
I20260805 22:37:32.081599 24012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.072224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:40339 (local address 127.19.77.190:33245)
0805 22:37:32.072331 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.072333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.072482 (+ 149us) server_negotiation.cc:407] Connection header received
0805 22:37:32.073003 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.073005 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.073030 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.073099 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.074196 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.074718 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.075892 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.076082 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.076163 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.078565 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.078567 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.078567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:32.078583 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.080016 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:32.080481 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:32.080482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:32.080482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:32.080546 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:32.080830 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:32.080831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:32.080832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:32.080954 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.081028 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.081400 (+ 372us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.081508 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 22:37:32.081840 24306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.072167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:33245 (local address 127.19.77.130:40339)
0805 22:37:32.072340 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.072386 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.072881 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.073248 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.073251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.073542 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:32.074085 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.074090 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.074824 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.074825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.075792 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.075795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.076206 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.076207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.076331 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.076868 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:32.076877 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:32.078442 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:32.080120 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:32.080130 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:32.080134 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:32.080384 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:32.080626 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:32.080627 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:32.080628 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:32.080745 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:32.081031 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:32.081040 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:32.081227 (+ 187us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.081363 (+ 136us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.081541 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260805 22:37:32.082425 24304 heartbeater.cc:347] Connected to a master server at 127.19.77.190:33245
I20260805 22:37:32.082518 24304 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:32.082695 24304 heartbeater.cc:511] Master 127.19.77.190:33245 requested a full tablet report, sending...
I20260805 22:37:32.083438 23972 ts_manager.cc:194] Registered new tserver with Master: 90ca9f71645f4f89875e9316e7387ae8 (127.19.77.130:46703)
I20260805 22:37:32.084012 23972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:40339
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:37:32.109850 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:33245
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:32.195458 24309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:32.195684 24309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:32.195712 24309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:32.196964 24309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:32.197011 24309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:32.197041 24309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:32.198621 24309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:33245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:32.198895 24309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:32.199244 24309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:32.204614 24315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:32.204597 24317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:32.204680 24309 server_base.cc:1034] running on GCE node
W20260805 22:37:32.204597 24314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:32.204978 24309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:32.205258 24309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:32.206430 24309 hybrid_clock.cc:648] HybridClock initialized: now 1785969452206415 us; error 30 us; skew 500 ppm
Aug 05 22:37:32 dist-test-slave-chsk krb5kdc[23927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969452, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:32.209283 24309 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:37:32.209712 24309 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:32.209789 24309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:32.209960 24309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:32.211222 24309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "247ee05c24c4499ebff6ad51274b8e0d"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "3f2442776970992a4d26e5dff60a2997"
server_key_iv: "be98ce88c74d0cdce961e8e278525dd9"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.211627 24309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "247ee05c24c4499ebff6ad51274b8e0d"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "3f2442776970992a4d26e5dff60a2997"
server_key_iv: "be98ce88c74d0cdce961e8e278525dd9"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.213053 24309 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:37:32.213897 24324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.214104 24309 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:32.214223 24309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "247ee05c24c4499ebff6ad51274b8e0d"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "3f2442776970992a4d26e5dff60a2997"
server_key_iv: "be98ce88c74d0cdce961e8e278525dd9"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.214311 24309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:32.226166 24309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:32.228773 24309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:32.228961 24309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:32.229236 24309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:32.229601 24309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:32.229660 24309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.229728 24309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:32.229760 24309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.235940 24309 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:35873
I20260805 22:37:32.236018 24440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:35873 every 8 connection(s)
I20260805 22:37:32.236312 24309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:37:32 dist-test-slave-chsk krb5kdc[23927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969452, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:32.245800 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 24309
I20260805 22:37:32.245937 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:32.246115 19766 external_mini_cluster.cc:1428] Setting key 150e685d435ab300670ccff5dc2003bd
I20260805 22:37:32.246914 24012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.237240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:41607 (local address 127.19.77.190:33245)
0805 22:37:32.237308 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.237311 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.237433 (+ 122us) server_negotiation.cc:407] Connection header received
0805 22:37:32.237880 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.237882 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.237895 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.237987 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.238965 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.239582 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.241022 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.241297 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.241356 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.243714 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.243715 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.243716 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:32.243723 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.245234 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:32.245647 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:32.245648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:32.245649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:32.245707 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:32.246069 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:32.246070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:32.246072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:32.246243 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.246320 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.246693 (+ 373us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.246804 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:37:32.247138 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.237057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:33245 (local address 127.19.77.131:41607)
0805 22:37:32.237254 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.237299 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.237795 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.238063 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.238067 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.238335 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:32.238851 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.238855 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.239766 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.239768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.240882 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.240888 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.241389 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.241390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.241509 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.242046 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:32.242054 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:32.243605 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:32.245318 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:32.245326 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:32.245328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:32.245559 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:32.245823 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:32.245824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:32.245825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:32.246001 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:32.246307 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:32.246314 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:32.246516 (+ 202us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.246655 (+ 139us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.246865 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":121,"threads_started":1}
I20260805 22:37:32.247649 24441 heartbeater.cc:347] Connected to a master server at 127.19.77.190:33245
I20260805 22:37:32.247748 24441 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:32.247920 24441 heartbeater.cc:511] Master 127.19.77.190:33245 requested a full tablet report, sending...
I20260805 22:37:32.248322 23972 ts_manager.cc:194] Registered new tserver with Master: 247ee05c24c4499ebff6ad51274b8e0d (127.19.77.131:35873)
I20260805 22:37:32.248715 23972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:41607
I20260805 22:37:32.258332 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:37:32.265981 24012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.259800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46390 (local address 127.19.77.190:33245)
0805 22:37:32.259850 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.259852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.259982 (+ 130us) server_negotiation.cc:407] Connection header received
0805 22:37:32.260016 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.260017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.260026 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.260076 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.260674 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.261182 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.261888 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.262092 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.262165 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.263451 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.263452 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.263453 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:32.263458 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.264905 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:32.265274 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:32.265275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:32.265276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:32.265331 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:32.265503 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:32.265504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:32.265504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:32.265654 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.265734 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.265820 (+ 86us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.265883 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:37:32.267907 23972 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46390:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:32.269794 23972 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:32.276610 24457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.272570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:46703 (local address 127.0.0.1:54410)
0805 22:37:32.272790 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.272801 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.272848 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.273170 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.273171 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.273172 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:32.273218 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.273220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.274161 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.274162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.275428 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.275431 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.276254 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.276255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.276346 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.276362 (+ 16us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.276465 (+ 103us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.276526 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":1,"thread_start_us":64,"threads_started":1}
I20260805 22:37:32.276621 24459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.272805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54410 (local address 127.19.77.130:46703)
0805 22:37:32.272966 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.272971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.272980 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:32.273032 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.273034 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.273068 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.273296 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:32.273364 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.274050 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.275522 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.276157 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.276252 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.276320 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.276486 (+ 166us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.276532 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":89,"threads_started":1}
I20260805 22:37:32.276823 24455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.272333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:40211 (local address 127.0.0.1:44502)
0805 22:37:32.272501 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.272546 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.272618 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.273229 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.273230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.273232 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:32.273310 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.273312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.274645 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.274646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.275697 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.275700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.276579 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.276580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.276657 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.276660 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.276691 (+ 31us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.276740 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":60,"threads_started":1}
I20260805 22:37:32.276934 24454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.272333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:35873 (local address 127.0.0.1:40956)
0805 22:37:32.272500 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.272551 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.272617 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.273095 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.273099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.273101 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:32.273184 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.273186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.274615 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.274616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.275667 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.275669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.276650 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.276650 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.276708 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.276711 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.276756 (+ 45us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.276789 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":5,"thread_start_us":98,"threads_started":1}
I20260805 22:37:32.277092 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.272456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40956 (local address 127.19.77.131:35873)
0805 22:37:32.272914 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.272918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.272929 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:32.272969 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.272971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.272989 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.273292 (+ 303us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:32.273372 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.274490 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.275752 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.276467 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.276558 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.276616 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.276862 (+ 246us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.276912 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":92,"threads_started":1}
I20260805 22:37:32.277194 24458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.272678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44502 (local address 127.19.77.129:40211)
0805 22:37:32.272862 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.272867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.272879 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:37:32.273099 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.273101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.273127 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.273386 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:32.273470 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.274523 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.275794 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.276482 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.276947 (+ 465us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.277028 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.277055 (+ 27us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.277104 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":116,"threads_started":1}
I20260805 22:37:32.277848 24237 tablet_service.cc:1467] Processing CreateTablet for tablet 1848f8b699c04ec98fca0f41c9f781dd (DEFAULT_TABLE table=test-table [id=61672784289248c6901fab3fdc101932]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:32.277848 24372 tablet_service.cc:1467] Processing CreateTablet for tablet 1848f8b699c04ec98fca0f41c9f781dd (DEFAULT_TABLE table=test-table [id=61672784289248c6901fab3fdc101932]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:32.277904 24099 tablet_service.cc:1467] Processing CreateTablet for tablet 1848f8b699c04ec98fca0f41c9f781dd (DEFAULT_TABLE table=test-table [id=61672784289248c6901fab3fdc101932]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:32.278251 24099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1848f8b699c04ec98fca0f41c9f781dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:32.278589 24237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1848f8b699c04ec98fca0f41c9f781dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:32.278589 24372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1848f8b699c04ec98fca0f41c9f781dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:32.281289 24460 tablet_bootstrap.cc:492] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2: Bootstrap starting.
I20260805 22:37:32.281968 24460 tablet_bootstrap.cc:654] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:32.282270 24461 tablet_bootstrap.cc:492] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: Bootstrap starting.
I20260805 22:37:32.282622 24460 log.cc:824] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:32.282943 24461 tablet_bootstrap.cc:654] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:32.282981 24462 tablet_bootstrap.cc:492] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8: Bootstrap starting.
I20260805 22:37:32.283605 24461 log.cc:824] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:32.283636 24462 tablet_bootstrap.cc:654] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:32.283646 24460 tablet_bootstrap.cc:492] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2: No bootstrap required, opened a new log
I20260805 22:37:32.283711 24460 ts_tablet_manager.cc:1397] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:37:32.284227 24462 log.cc:824] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:32.284529 24461 tablet_bootstrap.cc:492] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: No bootstrap required, opened a new log
I20260805 22:37:32.284621 24461 ts_tablet_manager.cc:1397] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260805 22:37:32.285060 24462 tablet_bootstrap.cc:492] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8: No bootstrap required, opened a new log
I20260805 22:37:32.285116 24462 ts_tablet_manager.cc:1397] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:37:32.285554 24460 raft_consensus.cc:348] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247ee05c24c4499ebff6ad51274b8e0d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35873 } } peers { permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 } } peers { permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 } }
I20260805 22:37:32.285682 24460 raft_consensus.cc:374] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:32.285703 24460 raft_consensus.cc:729] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8411478f887c4fd98344d55e368a61b2, State: Initialized, Role: FOLLOWER
I20260805 22:37:32.285830 24460 consensus_queue.cc:260] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247ee05c24c4499ebff6ad51274b8e0d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35873 } } peers { permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 } } peers { permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 } }
I20260805 22:37:32.286130 24167 heartbeater.cc:503] Master 127.19.77.190:33245 was elected leader, sending a full tablet report...
I20260805 22:37:32.286131 24460 ts_tablet_manager.cc:1428] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:37:32.286659 24461 raft_consensus.cc:348] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247ee05c24c4499ebff6ad51274b8e0d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35873 } } peers { permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 } } peers { permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 } }
I20260805 22:37:32.286813 24461 raft_consensus.cc:374] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:32.286844 24461 raft_consensus.cc:729] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247ee05c24c4499ebff6ad51274b8e0d, State: Initialized, Role: FOLLOWER
I20260805 22:37:32.286947 24461 consensus_queue.cc:260] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247ee05c24c4499ebff6ad51274b8e0d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35873 } } peers { permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 } } peers { permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 } }
I20260805 22:37:32.287117 24462 raft_consensus.cc:348] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247ee05c24c4499ebff6ad51274b8e0d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35873 } } peers { permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 } } peers { permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 } }
I20260805 22:37:32.287290 24462 raft_consensus.cc:374] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:32.287288 24461 ts_tablet_manager.cc:1428] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260805 22:37:32.287330 24462 raft_consensus.cc:729] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ca9f71645f4f89875e9316e7387ae8, State: Initialized, Role: FOLLOWER
I20260805 22:37:32.287288 24441 heartbeater.cc:503] Master 127.19.77.190:33245 was elected leader, sending a full tablet report...
I20260805 22:37:32.287441 24462 consensus_queue.cc:260] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247ee05c24c4499ebff6ad51274b8e0d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35873 } } peers { permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 } } peers { permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 } }
I20260805 22:37:32.287714 24462 ts_tablet_manager.cc:1428] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260805 22:37:32.287957 24304 heartbeater.cc:503] Master 127.19.77.190:33245 was elected leader, sending a full tablet report...
W20260805 22:37:32.322052 24305 tablet.cc:2369] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:37:32.352952 24467 raft_consensus.cc:482] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:32.353091 24467 raft_consensus.cc:504] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247ee05c24c4499ebff6ad51274b8e0d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35873 } } peers { permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 } } peers { permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 } }
I20260805 22:37:32.353466 24467 leader_election.cc:288] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8411478f887c4fd98344d55e368a61b2 (127.19.77.129:40211), 90ca9f71645f4f89875e9316e7387ae8 (127.19.77.130:46703)
I20260805 22:37:32.356722 24459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.353984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:46785 (local address 127.19.77.130:46703)
0805 22:37:32.354049 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.354051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.354170 (+ 119us) server_negotiation.cc:407] Connection header received
0805 22:37:32.354201 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.354202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.354221 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.354276 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:32.354466 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.354944 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.355957 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.356329 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.356419 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.356428 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.356601 (+ 173us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.356642 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:37:32.356714 24458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.353821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:40471 (local address 127.19.77.129:40211)
0805 22:37:32.353908 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.353910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.353921 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:32.353953 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.353954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.353970 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.354057 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:32.354323 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.354872 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.355920 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.356323 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.356405 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.356416 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.356587 (+ 171us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.356633 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 22:37:32.356722 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.353725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:40211 (local address 127.19.77.131:40471)
0805 22:37:32.353791 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.353805 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.353857 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.354098 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.354099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.354101 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:32.354216 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.354219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.354956 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.354957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.355813 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.355816 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.356407 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.356408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.356497 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.356500 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.356545 (+ 45us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.356608 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":55}
I20260805 22:37:32.356743 24469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.353852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:46703 (local address 127.19.77.131:46785)
0805 22:37:32.354078 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.354086 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.354137 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.354316 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.354317 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.354319 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:32.354391 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.354393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.355032 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.355033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.355827 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:32.355830 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.356436 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.356437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:32.356506 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.356509 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.356594 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.356632 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":1,"thread_start_us":148,"threads_started":1}
I20260805 22:37:32.357148 24258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1848f8b699c04ec98fca0f41c9f781dd" candidate_uuid: "247ee05c24c4499ebff6ad51274b8e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ca9f71645f4f89875e9316e7387ae8" is_pre_election: true
I20260805 22:37:32.357189 24121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1848f8b699c04ec98fca0f41c9f781dd" candidate_uuid: "247ee05c24c4499ebff6ad51274b8e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8411478f887c4fd98344d55e368a61b2" is_pre_election: true
I20260805 22:37:32.357334 24258 raft_consensus.cc:2454] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247ee05c24c4499ebff6ad51274b8e0d in term 0.
I20260805 22:37:32.357349 24121 raft_consensus.cc:2454] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247ee05c24c4499ebff6ad51274b8e0d in term 0.
I20260805 22:37:32.357599 24328 leader_election.cc:302] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247ee05c24c4499ebff6ad51274b8e0d, 8411478f887c4fd98344d55e368a61b2; no voters:
I20260805 22:37:32.357730 24467 raft_consensus.cc:2781] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:32.357787 24467 raft_consensus.cc:482] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:32.357812 24467 raft_consensus.cc:3037] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:32.358523 24467 raft_consensus.cc:504] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247ee05c24c4499ebff6ad51274b8e0d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35873 } } peers { permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 } } peers { permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 } }
I20260805 22:37:32.358698 24467 leader_election.cc:288] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [CANDIDATE]: Term 1 election: Requested vote from peers 8411478f887c4fd98344d55e368a61b2 (127.19.77.129:40211), 90ca9f71645f4f89875e9316e7387ae8 (127.19.77.130:46703)
I20260805 22:37:32.358865 24121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1848f8b699c04ec98fca0f41c9f781dd" candidate_uuid: "247ee05c24c4499ebff6ad51274b8e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8411478f887c4fd98344d55e368a61b2"
I20260805 22:37:32.358899 24258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1848f8b699c04ec98fca0f41c9f781dd" candidate_uuid: "247ee05c24c4499ebff6ad51274b8e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ca9f71645f4f89875e9316e7387ae8"
I20260805 22:37:32.358969 24258 raft_consensus.cc:3037] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:32.358964 24121 raft_consensus.cc:3037] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:32.359990 24121 raft_consensus.cc:2454] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247ee05c24c4499ebff6ad51274b8e0d in term 1.
I20260805 22:37:32.359990 24258 raft_consensus.cc:2454] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247ee05c24c4499ebff6ad51274b8e0d in term 1.
I20260805 22:37:32.360293 24328 leader_election.cc:302] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247ee05c24c4499ebff6ad51274b8e0d, 90ca9f71645f4f89875e9316e7387ae8; no voters:
I20260805 22:37:32.360397 24467 raft_consensus.cc:2781] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:32.360598 24467 raft_consensus.cc:686] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 1 LEADER]: Becoming Leader. State: Replica: 247ee05c24c4499ebff6ad51274b8e0d, State: Running, Role: LEADER
I20260805 22:37:32.360709 24467 consensus_queue.cc:237] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247ee05c24c4499ebff6ad51274b8e0d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35873 } } peers { permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 } } peers { permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 } }
I20260805 22:37:32.361622 23972 catalog_manager.cc:5495] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 247ee05c24c4499ebff6ad51274b8e0d (127.19.77.131). New cstate: current_term: 1 leader_uuid: "247ee05c24c4499ebff6ad51274b8e0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247ee05c24c4499ebff6ad51274b8e0d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 } health_report { overall_health: UNKNOWN } } }
I20260805 22:37:32.369304 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.366783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40970 (local address 127.19.77.131:35873)
0805 22:37:32.366825 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.366827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.366835 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:37:32.366913 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.366914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.366930 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.366991 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:32.367115 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.367632 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.368374 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:32.368553 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:32.368610 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:32.368817 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:32.368963 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:32.369061 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.369131 (+ 70us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.369158 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:37:32.371282 24121 raft_consensus.cc:1261] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2 [term 1 FOLLOWER]: Refusing update from remote peer 247ee05c24c4499ebff6ad51274b8e0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:32.371294 24258 raft_consensus.cc:1261] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8 [term 1 FOLLOWER]: Refusing update from remote peer 247ee05c24c4499ebff6ad51274b8e0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:32.371659 24470 consensus_queue.cc:1035] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8411478f887c4fd98344d55e368a61b2" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 40211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:32.371814 24467 consensus_queue.cc:1035] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ca9f71645f4f89875e9316e7387ae8" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:32.375442 24474 mvcc.cc:205] Tried to move back new op lower bound from 7315330876909826048 to 7315330876870242304. Current Snapshot: MvccSnapshot[applied={T|T < 7315330876909826048 or (T in {7315330876909826048})}]
I20260805 22:37:32.376857 23970 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:32.376976 23970 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:32.377863 23970 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a9806703b1d441729af11fe6efe37005: Sending DeleteTablet for 3 replicas of tablet 1848f8b699c04ec98fca0f41c9f781dd
I20260805 22:37:32.378315 24099 tablet_service.cc:1514] Processing DeleteTablet for tablet 1848f8b699c04ec98fca0f41c9f781dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:32 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:44502
I20260805 22:37:32.378366 24237 tablet_service.cc:1514] Processing DeleteTablet for tablet 1848f8b699c04ec98fca0f41c9f781dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:32 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:54410
I20260805 22:37:32.378582 24372 tablet_service.cc:1514] Processing DeleteTablet for tablet 1848f8b699c04ec98fca0f41c9f781dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:32 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:40956
I20260805 22:37:32.378829 24484 tablet_replica.cc:330] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: stopping tablet replica
I20260805 22:37:32.378839 24482 tablet_replica.cc:330] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2: stopping tablet replica
I20260805 22:37:32.378964 24484 raft_consensus.cc:2229] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:32.379011 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 24036
I20260805 22:37:32.379034 24482 raft_consensus.cc:2229] T 1848f8b699c04ec98fca0f41c9f781dd P 8411478f887c4fd98344d55e368a61b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:32.380082 24484 raft_consensus.cc:2258] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:32.380651 24484 ts_tablet_manager.cc:1905] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:32.382702 24484 ts_tablet_manager.cc:1918] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:32.382807 24484 log.cc:1196] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/1848f8b699c04ec98fca0f41c9f781dd
I20260805 22:37:32.383164 24484 ts_tablet_manager.cc:1939] T 1848f8b699c04ec98fca0f41c9f781dd P 247ee05c24c4499ebff6ad51274b8e0d: Deleting consensus metadata
I20260805 22:37:32.383708 23957 catalog_manager.cc:4841] TS 247ee05c24c4499ebff6ad51274b8e0d (127.19.77.131:35873): tablet 1848f8b699c04ec98fca0f41c9f781dd (table test-table [id=61672784289248c6901fab3fdc101932]) successfully deleted
W20260805 22:37:32.387625 23959 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:40211 (error 108)
I20260805 22:37:32.387761 24483 tablet_replica.cc:330] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8: stopping tablet replica
I20260805 22:37:32.387959 24483 raft_consensus.cc:2229] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:32.388180 24483 raft_consensus.cc:2258] T 1848f8b699c04ec98fca0f41c9f781dd P 90ca9f71645f4f89875e9316e7387ae8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:32.388419 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 24172
I20260805 22:37:32.389308 24454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.389005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:40211 (local address 127.0.0.1:44506)
0805 22:37:32.389208 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.389260 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:40211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178}
I20260805 22:37:32.395591 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 24309
W20260805 22:37:32.395605 23959 catalog_manager.cc:4584] TS 8411478f887c4fd98344d55e368a61b2 (127.19.77.129:40211): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1848f8b699c04ec98fca0f41c9f781dd: Network error: Client connection negotiation failed: client connection to 127.19.77.129:40211: connect: Connection refused (error 111)
I20260805 22:37:32.396795 24454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.396667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:46703 (local address 127.0.0.1:54418)
0805 22:37:32.396722 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.396749 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.130:46703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260805 22:37:32.401547 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 23940
2026-08-05T22:37:32Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2057 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-05T22:37:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:32Z Disabled control of system clock
I20260805 22:37:32.434049 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:46655
--webserver_interface=127.19.77.190
--webserver_port=0
--builtin_ntp_servers=127.19.77.148:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:46655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 22:37:32.519119 24489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:32.519407 24489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:32.519431 24489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:32.520689 24489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:32.520746 24489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:32.520761 24489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:32.520773 24489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:32.520787 24489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:32.522287 24489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:46655
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:46655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:32.522608 24489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:32.522912 24489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:32.527968 24495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:32.527961 24496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:32.527961 24498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:32.528486 24489 server_base.cc:1034] running on GCE node
I20260805 22:37:32.528765 24489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:32.529116 24489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:32.530287 24489 hybrid_clock.cc:648] HybridClock initialized: now 1785969452530265 us; error 31 us; skew 500 ppm
I20260805 22:37:32.531795 24489 webserver.cc:460] Webserver started at http://127.19.77.190:40469/ using document root <none> and password file <none>
I20260805 22:37:32.532083 24489 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:32.532138 24489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:32.532275 24489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:32.533449 24489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "19d1871d20ed4b0f98a7659bb25e58ae"
server_key_iv: "0485c07859d742fb731af26d001f1603"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.533833 24489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "19d1871d20ed4b0f98a7659bb25e58ae"
server_key_iv: "0485c07859d742fb731af26d001f1603"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.535885 24489 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260805 22:37:32.536775 24504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.536973 24489 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:32.537249 24489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "19d1871d20ed4b0f98a7659bb25e58ae"
server_key_iv: "0485c07859d742fb731af26d001f1603"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.537344 24489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:32.541110 24489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:32.541465 24489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:32.541623 24489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:32.545827 24489 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:46655
I20260805 22:37:32.545864 24559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:46655 every 8 connection(s)
I20260805 22:37:32.546228 24489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:32.546917 24560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:32.549300 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 24489
I20260805 22:37:32.549394 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:32.549595 19766 external_mini_cluster.cc:1428] Setting key 33fbad370ac76125b28d4fb198747284
I20260805 22:37:32.550177 24560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6: Bootstrap starting.
I20260805 22:37:32.550932 24560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:32.551348 24560 log.cc:824] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:32.552205 24560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6: No bootstrap required, opened a new log
I20260805 22:37:32.552451 24563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.550199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60876 (local address 127.19.77.190:46655)
0805 22:37:32.550408 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.550417 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.550448 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:37:32.551078 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.551089 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.551177 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.551331 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.552016 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.552019 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.552020 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:32.552024 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.552069 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:32.552082 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.552174 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.552203 (+ 29us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.552258 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":79,"threads_started":1}
I20260805 22:37:32.554219 24560 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46655 } }
I20260805 22:37:32.554359 24560 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:32.554382 24560 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf16d57e43a4d8a8c75bf49a222dbc6, State: Initialized, Role: FOLLOWER
I20260805 22:37:32.554531 24560 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46655 } }
I20260805 22:37:32.554603 24560 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:32.554664 24560 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:32.554718 24560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:32.555337 24560 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46655 } }
I20260805 22:37:32.555452 24560 leader_election.cc:302] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdf16d57e43a4d8a8c75bf49a222dbc6; no voters:
I20260805 22:37:32.555635 24560 leader_election.cc:288] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:32.555716 24565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:32.555902 24565 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [term 1 LEADER]: Becoming Leader. State: Replica: bdf16d57e43a4d8a8c75bf49a222dbc6, State: Running, Role: LEADER
I20260805 22:37:32.555961 24560 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:32.556028 24565 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46655 } }
I20260805 22:37:32.556439 24567 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdf16d57e43a4d8a8c75bf49a222dbc6. Latest consensus state: current_term: 1 leader_uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46655 } } }
I20260805 22:37:32.556438 24566 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf16d57e43a4d8a8c75bf49a222dbc6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46655 } } }
I20260805 22:37:32.556684 24567 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:32.556685 24566 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:32.556913 24571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:32.557446 24571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:32.559253 24571 catalog_manager.cc:1347] Generated new cluster ID: 52aad09ec90446769b3aa16493e926b7
I20260805 22:37:32.559310 24571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:32.566138 24571 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:32.566329 24571 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:32.576951 24571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6: Generated new TSK 0
I20260805 22:37:32.577183 24571 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:37:32.580437 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46655
--builtin_ntp_servers=127.19.77.148:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 22:37:32.667531 24584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:32.667745 24584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:32.667770 24584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:32.668980 24584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:32.669024 24584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:32.669052 24584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:32.670424 24584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:32.670693 24584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:32.671020 24584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:32.677491 24589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:32.677502 24592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:32.677735 24584 server_base.cc:1034] running on GCE node
W20260805 22:37:32.677516 24590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:32.678030 24584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:32.678316 24584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:32.679481 24584 hybrid_clock.cc:648] HybridClock initialized: now 1785969452679459 us; error 36 us; skew 500 ppm
I20260805 22:37:32.686491 24584 webserver.cc:460] Webserver started at http://127.19.77.129:46727/ using document root <none> and password file <none>
I20260805 22:37:32.686734 24584 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:32.686784 24584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:32.686890 24584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:32.688032 24584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "fa208d6e5a984a5e9ef2888c2b49a681"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "758d7842caadca5ce6b8154869752d07"
server_key_iv: "3765c90030a47c62fab9ed1215e9e910"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.688442 24584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "fa208d6e5a984a5e9ef2888c2b49a681"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "758d7842caadca5ce6b8154869752d07"
server_key_iv: "3765c90030a47c62fab9ed1215e9e910"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.689855 24584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:37:32.690676 24598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.690887 24584 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:32.690966 24584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "fa208d6e5a984a5e9ef2888c2b49a681"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "758d7842caadca5ce6b8154869752d07"
server_key_iv: "3765c90030a47c62fab9ed1215e9e910"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.691025 24584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:32.694829 24584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:32.695132 24584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:32.695259 24584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:32.695430 24584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:32.695719 24584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:32.695753 24584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.695776 24584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:32.695789 24584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.702112 24584 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:35927
I20260805 22:37:32.702209 24714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:35927 every 8 connection(s)
I20260805 22:37:32.702471 24584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:32.705855 24563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.703315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:52139 (local address 127.19.77.190:46655)
0805 22:37:32.703388 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.703390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.703655 (+ 265us) server_negotiation.cc:407] Connection header received
0805 22:37:32.704211 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.704212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.704219 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.704281 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.705591 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.705593 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.705594 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:32.705599 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.705614 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:32.705619 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.705673 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.705765 (+ 92us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.705781 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:37:32.706077 24717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.703319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:46655 (local address 127.19.77.129:52139)
0805 22:37:32.703525 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.703561 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.704093 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.704356 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.704360 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.704377 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:32.705432 (+ 1055us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:37:32.705432 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:32.705462 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:37:32.705492 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:32.705669 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:32.705675 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:32.705679 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.705776 (+ 97us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.705841 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
I20260805 22:37:32.706576 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 24584
I20260805 22:37:32.706686 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:32.706720 24715 heartbeater.cc:347] Connected to a master server at 127.19.77.190:46655
I20260805 22:37:32.706812 24715 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:32.706902 19766 external_mini_cluster.cc:1428] Setting key 5fa75268e087e076cc923f62435f072d
I20260805 22:37:32.706975 24715 heartbeater.cc:511] Master 127.19.77.190:46655 requested a full tablet report, sending...
I20260805 22:37:32.707527 24520 ts_manager.cc:194] Registered new tserver with Master: fa208d6e5a984a5e9ef2888c2b49a681 (127.19.77.129:35927)
I20260805 22:37:32.707947 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46655
--builtin_ntp_servers=127.19.77.148:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 22:37:32.799768 24718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:32.800009 24718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:32.800034 24718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:32.802696 24718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:32.802824 24718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:32.802871 24718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:32.805891 24718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:32.806191 24718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:32.806476 24718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:32.811749 24724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:32.811723 24723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:32.811761 24718 server_base.cc:1034] running on GCE node
W20260805 22:37:32.811738 24726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:32.812224 24718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:32.812477 24718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:32.813635 24718 hybrid_clock.cc:648] HybridClock initialized: now 1785969452813620 us; error 30 us; skew 500 ppm
I20260805 22:37:32.815017 24718 webserver.cc:460] Webserver started at http://127.19.77.130:42045/ using document root <none> and password file <none>
I20260805 22:37:32.815304 24718 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:32.815354 24718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:32.815512 24718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:32.816627 24718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "f149e91b6c614bafa5c9a282ab004e36"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "902edabe25861755792f412b61390f8e"
server_key_iv: "9414a235e5550c0e5e675057d177f216"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.817013 24718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "f149e91b6c614bafa5c9a282ab004e36"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "902edabe25861755792f412b61390f8e"
server_key_iv: "9414a235e5550c0e5e675057d177f216"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.818435 24718 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:32.819401 24732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.819607 24718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:32.819725 24718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "f149e91b6c614bafa5c9a282ab004e36"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "902edabe25861755792f412b61390f8e"
server_key_iv: "9414a235e5550c0e5e675057d177f216"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.819808 24718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:32.823333 24718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:32.823640 24718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:32.823807 24718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:32.824038 24718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:32.824375 24718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:32.824436 24718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.824477 24718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:32.824505 24718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.830595 24718 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:38259
I20260805 22:37:32.830648 24848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:38259 every 8 connection(s)
I20260805 22:37:32.831008 24718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:32.833645 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 24718
I20260805 22:37:32.833732 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:32.833933 19766 external_mini_cluster.cc:1428] Setting key ba04f0940fac3d7f53056b014b1325a4
I20260805 22:37:32.834175 24563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.831791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:39947 (local address 127.19.77.190:46655)
0805 22:37:32.831838 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.831841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.832072 (+ 231us) server_negotiation.cc:407] Connection header received
0805 22:37:32.832524 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.832525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.832531 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.832593 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.833842 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.833844 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.833844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:32.833849 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.833866 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:32.833871 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.833939 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.834081 (+ 142us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.834101 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:37:32.834705 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.831778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:46655 (local address 127.19.77.130:39947)
0805 22:37:32.831944 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.831979 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.832441 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.832654 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.832657 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.832671 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:32.833649 (+ 978us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:37:32.833649 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:32.833678 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:37:32.833741 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:32.833937 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:32.833945 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:32.833948 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.834083 (+ 135us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.834151 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
I20260805 22:37:32.835126 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46655
--builtin_ntp_servers=127.19.77.148:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260805 22:37:32.835240 24849 heartbeater.cc:347] Connected to a master server at 127.19.77.190:46655
I20260805 22:37:32.835331 24849 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:32.835486 24849 heartbeater.cc:511] Master 127.19.77.190:46655 requested a full tablet report, sending...
I20260805 22:37:32.835892 24520 ts_manager.cc:194] Registered new tserver with Master: f149e91b6c614bafa5c9a282ab004e36 (127.19.77.130:38259)
W20260805 22:37:32.921236 24852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:32.921514 24852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:32.921552 24852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:32.922869 24852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:32.922935 24852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:32.922991 24852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:32.924588 24852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:32.924890 24852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:32.925215 24852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:32.930438 24857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:32.930451 24860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:32.930682 24852 server_base.cc:1034] running on GCE node
W20260805 22:37:32.930444 24858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:32.930967 24852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:32.931283 24852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:32.932471 24852 hybrid_clock.cc:648] HybridClock initialized: now 1785969452932459 us; error 34 us; skew 500 ppm
I20260805 22:37:32.933787 24852 webserver.cc:460] Webserver started at http://127.19.77.131:35845/ using document root <none> and password file <none>
I20260805 22:37:32.934062 24852 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:32.934113 24852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:32.934312 24852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:32.935567 24852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "1da5eb22c72d44e6b4c2b1eb8912c190"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "f2662bc07a42120eb42c6f3cf7ef797d"
server_key_iv: "ebe9ec14988bc13ba789dd7d219132c1"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.935994 24852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "1da5eb22c72d44e6b4c2b1eb8912c190"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "f2662bc07a42120eb42c6f3cf7ef797d"
server_key_iv: "ebe9ec14988bc13ba789dd7d219132c1"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.937448 24852 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:37:32.938257 24866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.938454 24852 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:32.938557 24852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "1da5eb22c72d44e6b4c2b1eb8912c190"
format_stamp: "Formatted at 2026-08-05 22:37:32 on dist-test-slave-chsk"
server_key: "f2662bc07a42120eb42c6f3cf7ef797d"
server_key_iv: "ebe9ec14988bc13ba789dd7d219132c1"
server_key_version: "encryptionkey@0"
I20260805 22:37:32.938647 24852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:32.942535 24852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:32.942828 24852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:32.942978 24852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:32.943259 24852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:32.943588 24852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:32.943645 24852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.943688 24852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:32.943717 24852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:32.949749 24852 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:36659
I20260805 22:37:32.949790 24983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:36659 every 8 connection(s)
I20260805 22:37:32.950155 24852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:37:32.951015 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 24852
I20260805 22:37:32.951139 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:32.951414 19766 external_mini_cluster.cc:1428] Setting key d84c01ea506838249e064516ddc55357
I20260805 22:37:32.953486 24563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.950989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:58451 (local address 127.19.77.190:46655)
0805 22:37:32.951071 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.951075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.951356 (+ 281us) server_negotiation.cc:407] Connection header received
0805 22:37:32.951949 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.951950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.951958 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.952018 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.953282 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.953284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.953284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:32.953288 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.953303 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:32.953307 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.953366 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.953419 (+ 53us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.953430 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:37:32.953694 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.950964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:46655 (local address 127.19.77.131:58451)
0805 22:37:32.951204 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.951254 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.951827 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.952086 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.952090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.952106 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:32.953157 (+ 1051us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:37:32.953158 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:32.953186 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:37:32.953212 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:32.953367 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:32.953370 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:32.953372 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.953422 (+ 50us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.953469 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":118,"threads_started":1}
I20260805 22:37:32.954173 24984 heartbeater.cc:347] Connected to a master server at 127.19.77.190:46655
I20260805 22:37:32.954257 24984 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:32.954427 24984 heartbeater.cc:511] Master 127.19.77.190:46655 requested a full tablet report, sending...
I20260805 22:37:32.954775 24520 ts_manager.cc:194] Registered new tserver with Master: 1da5eb22c72d44e6b4c2b1eb8912c190 (127.19.77.131:36659)
I20260805 22:37:32.963419 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:37:32.966121 24563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.964837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60880 (local address 127.19.77.190:46655)
0805 22:37:32.964924 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.964926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.965043 (+ 117us) server_negotiation.cc:407] Connection header received
0805 22:37:32.965168 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.965169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.965176 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.965251 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.965869 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.965871 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.965871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:32.965876 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.965891 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:32.965896 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.965964 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.966024 (+ 60us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.966040 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:37:32.967810 24520 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60880:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:32.969456 24520 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:32.973652 24993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.971690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:36659 (local address 127.0.0.1:49186)
0805 22:37:32.971889 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.971930 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.971989 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.972278 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.972285 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.972292 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:32.973149 (+ 857us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:37:32.973149 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:32.973163 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:37:32.973181 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:32.973419 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:32.973426 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:32.973433 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.973542 (+ 109us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.973581 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":22,"thread_start_us":112,"threads_started":1}
I20260805 22:37:32.973665 24995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.971795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39404 (local address 127.19.77.130:38259)
0805 22:37:32.972011 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.972016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.972204 (+ 188us) server_negotiation.cc:407] Connection header received
0805 22:37:32.972236 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.972239 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.972248 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.972314 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.973318 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.973326 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.973326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:32.973331 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.973363 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:32.973398 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.973469 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.973547 (+ 78us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.973565 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":95,"threads_started":1}
I20260805 22:37:32.973711 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.971752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49186 (local address 127.19.77.131:36659)
0805 22:37:32.972141 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.972145 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.972156 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:32.972184 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.972186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.972197 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.972279 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.973269 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.973278 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.973279 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:32.973283 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.973321 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:32.973350 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.973434 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.973596 (+ 162us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.973621 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":91,"threads_started":1}
I20260805 22:37:32.974014 24997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.972172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41254 (local address 127.19.77.129:35927)
0805 22:37:32.972369 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:32.972373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:32.972383 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:32.972410 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:32.972412 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:32.972422 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:32.972498 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:32.973604 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:32.973614 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:32.973614 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:32.973618 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:32.973650 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:32.973676 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:32.973732 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:32.973943 (+ 211us) server_negotiation.cc:299] Negotiation successful
0805 22:37:32.973957 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":85,"threads_started":1}
I20260805 22:37:32.973891 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.971923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:35927 (local address 127.0.0.1:41254)
0805 22:37:32.972082 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.972092 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.972141 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.972796 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.972797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.972800 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:32.973498 (+ 698us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:37:32.973498 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:32.973504 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:37:32.973519 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:32.973762 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:32.973764 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:32.973764 (+ 0us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.973811 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.973824 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260805 22:37:32.974225 24996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:32.971691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:38259 (local address 127.0.0.1:39404)
0805 22:37:32.972071 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:32.972081 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:32.972141 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:32.972608 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:32.972609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:32.972612 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:32.973226 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:37:32.973226 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:32.973234 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:37:32.973248 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:32.973470 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:32.973471 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:32.973471 (+ 0us) client_negotiation.cc:769] Sending connection context
0805 22:37:32.973545 (+ 74us) client_negotiation.cc:240] Negotiation successful
0805 22:37:32.974148 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":82,"threads_started":1}
I20260805 22:37:32.974834 24916 tablet_service.cc:1467] Processing CreateTablet for tablet ea70aef8dd8c4f5a9f368af6587e180c (DEFAULT_TABLE table=test-table [id=a8e474db4d8847c6945747d075759002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:32.974946 24783 tablet_service.cc:1467] Processing CreateTablet for tablet ea70aef8dd8c4f5a9f368af6587e180c (DEFAULT_TABLE table=test-table [id=a8e474db4d8847c6945747d075759002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:32.975276 24916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea70aef8dd8c4f5a9f368af6587e180c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:32.975342 24783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea70aef8dd8c4f5a9f368af6587e180c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:32.978029 24998 tablet_bootstrap.cc:492] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: Bootstrap starting.
I20260805 22:37:32.978168 24999 tablet_bootstrap.cc:492] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: Bootstrap starting.
I20260805 22:37:32.978605 24649 tablet_service.cc:1467] Processing CreateTablet for tablet ea70aef8dd8c4f5a9f368af6587e180c (DEFAULT_TABLE table=test-table [id=a8e474db4d8847c6945747d075759002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:32.978824 24999 tablet_bootstrap.cc:654] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:32.978861 24998 tablet_bootstrap.cc:654] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:32.978988 24649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea70aef8dd8c4f5a9f368af6587e180c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:32.979065 24999 log.cc:824] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:32.979206 24998 log.cc:824] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:32.979990 24998 tablet_bootstrap.cc:492] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: No bootstrap required, opened a new log
I20260805 22:37:32.980013 24999 tablet_bootstrap.cc:492] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: No bootstrap required, opened a new log
I20260805 22:37:32.980057 24998 ts_tablet_manager.cc:1397] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:32.980073 24999 ts_tablet_manager.cc:1397] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:32.981904 24998 raft_consensus.cc:348] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 } } peers { permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 } } peers { permanent_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 35927 } }
I20260805 22:37:32.982052 24998 raft_consensus.cc:374] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:32.982075 24998 raft_consensus.cc:729] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f149e91b6c614bafa5c9a282ab004e36, State: Initialized, Role: FOLLOWER
I20260805 22:37:32.982208 24998 consensus_queue.cc:260] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 } } peers { permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 } } peers { permanent_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 35927 } }
I20260805 22:37:32.982504 24998 ts_tablet_manager.cc:1428] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:37:32.982642 24849 heartbeater.cc:503] Master 127.19.77.190:46655 was elected leader, sending a full tablet report...
I20260805 22:37:32.983527 24999 raft_consensus.cc:348] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 } } peers { permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 } } peers { permanent_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 35927 } }
I20260805 22:37:32.983731 24999 raft_consensus.cc:374] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:32.983785 24999 raft_consensus.cc:729] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da5eb22c72d44e6b4c2b1eb8912c190, State: Initialized, Role: FOLLOWER
I20260805 22:37:32.983953 24999 consensus_queue.cc:260] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 } } peers { permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 } } peers { permanent_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 35927 } }
I20260805 22:37:32.984249 24999 ts_tablet_manager.cc:1428] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260805 22:37:32.984274 24984 heartbeater.cc:503] Master 127.19.77.190:46655 was elected leader, sending a full tablet report...
I20260805 22:37:32.984488 25003 tablet_bootstrap.cc:492] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681: Bootstrap starting.
I20260805 22:37:32.985257 25003 tablet_bootstrap.cc:654] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:32.985513 25003 log.cc:824] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:32.986181 25003 tablet_bootstrap.cc:492] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681: No bootstrap required, opened a new log
I20260805 22:37:32.986236 25003 ts_tablet_manager.cc:1397] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:32.988296 25003 raft_consensus.cc:348] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 } } peers { permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 } } peers { permanent_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 35927 } }
I20260805 22:37:32.988432 25003 raft_consensus.cc:374] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:32.988454 25003 raft_consensus.cc:729] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa208d6e5a984a5e9ef2888c2b49a681, State: Initialized, Role: FOLLOWER
I20260805 22:37:32.988574 25003 consensus_queue.cc:260] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 } } peers { permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 } } peers { permanent_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 35927 } }
I20260805 22:37:32.988849 25003 ts_tablet_manager.cc:1428] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:37:32.988878 24715 heartbeater.cc:503] Master 127.19.77.190:46655 was elected leader, sending a full tablet report...
I20260805 22:37:33.074203 25006 raft_consensus.cc:482] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:33.074343 25006 raft_consensus.cc:504] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 } } peers { permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 } } peers { permanent_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 35927 } }
I20260805 22:37:33.074719 25006 leader_election.cc:288] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f149e91b6c614bafa5c9a282ab004e36 (127.19.77.130:38259), 1da5eb22c72d44e6b4c2b1eb8912c190 (127.19.77.131:36659)
I20260805 22:37:33.076295 24717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.074957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:38259 (local address 127.19.77.129:35271)
0805 22:37:33.075025 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:33.075037 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:33.075105 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:33.075304 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:33.075306 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:33.075309 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:33.075842 (+ 533us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:37:33.075842 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:33.075851 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:37:33.075866 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:33.076133 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:33.076135 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:33.076136 (+ 1us) client_negotiation.cc:769] Sending connection context
0805 22:37:33.076197 (+ 61us) client_negotiation.cc:240] Negotiation successful
0805 22:37:33.076212 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260805 22:37:33.076331 24995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.075064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:35271 (local address 127.19.77.130:38259)
0805 22:37:33.075131 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:33.075134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:33.075175 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:37:33.075210 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:33.075211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:33.075217 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:33.075280 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:33.075978 (+ 698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:33.075980 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:33.075980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:33.075986 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:33.076005 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:33.076011 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:33.076090 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:33.076234 (+ 144us) server_negotiation.cc:299] Negotiation successful
0805 22:37:33.076250 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:37:33.076391 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.075196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:38949 (local address 127.19.77.131:36659)
0805 22:37:33.075267 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:33.075269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:33.075386 (+ 117us) server_negotiation.cc:407] Connection header received
0805 22:37:33.075456 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:33.075457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:33.075462 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:33.075533 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:33.076147 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:33.076148 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:33.076148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:33.076154 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:33.076172 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:33.076177 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:33.076234 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:33.076300 (+ 66us) server_negotiation.cc:299] Negotiation successful
0805 22:37:33.076313 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260805 22:37:33.076403 25007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.075089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:36659 (local address 127.19.77.129:38949)
0805 22:37:33.075316 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:33.075325 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:33.075390 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:33.075536 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:33.075537 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:33.075540 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:33.076022 (+ 482us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:37:33.076023 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:33.076030 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:37:33.076043 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:33.076245 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:33.076246 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:33.076246 (+ 0us) client_negotiation.cc:769] Sending connection context
0805 22:37:33.076300 (+ 54us) client_negotiation.cc:240] Negotiation successful
0805 22:37:33.076314 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":149,"threads_started":1}
I20260805 22:37:33.076730 24803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea70aef8dd8c4f5a9f368af6587e180c" candidate_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f149e91b6c614bafa5c9a282ab004e36" is_pre_election: true
I20260805 22:37:33.076890 24803 raft_consensus.cc:2454] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa208d6e5a984a5e9ef2888c2b49a681 in term 0.
I20260805 22:37:33.076866 24937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea70aef8dd8c4f5a9f368af6587e180c" candidate_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" is_pre_election: true
I20260805 22:37:33.077034 24937 raft_consensus.cc:2454] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa208d6e5a984a5e9ef2888c2b49a681 in term 0.
I20260805 22:37:33.077178 24601 leader_election.cc:302] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f149e91b6c614bafa5c9a282ab004e36, fa208d6e5a984a5e9ef2888c2b49a681; no voters:
I20260805 22:37:33.077389 25006 raft_consensus.cc:2781] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:33.077471 25006 raft_consensus.cc:482] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:33.077508 25006 raft_consensus.cc:3037] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:33.078281 25006 raft_consensus.cc:504] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 } } peers { permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 } } peers { permanent_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 35927 } }
I20260805 22:37:33.078459 25006 leader_election.cc:288] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [CANDIDATE]: Term 1 election: Requested vote from peers f149e91b6c614bafa5c9a282ab004e36 (127.19.77.130:38259), 1da5eb22c72d44e6b4c2b1eb8912c190 (127.19.77.131:36659)
I20260805 22:37:33.078621 24937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea70aef8dd8c4f5a9f368af6587e180c" candidate_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190"
I20260805 22:37:33.078723 24937 raft_consensus.cc:3037] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:33.078750 24803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea70aef8dd8c4f5a9f368af6587e180c" candidate_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f149e91b6c614bafa5c9a282ab004e36"
I20260805 22:37:33.078845 24803 raft_consensus.cc:3037] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:33.079607 24937 raft_consensus.cc:2454] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa208d6e5a984a5e9ef2888c2b49a681 in term 1.
I20260805 22:37:33.079811 24803 raft_consensus.cc:2454] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa208d6e5a984a5e9ef2888c2b49a681 in term 1.
I20260805 22:37:33.079842 24602 leader_election.cc:302] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da5eb22c72d44e6b4c2b1eb8912c190, fa208d6e5a984a5e9ef2888c2b49a681; no voters:
I20260805 22:37:33.079941 25006 raft_consensus.cc:2781] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:33.080112 25006 raft_consensus.cc:686] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 1 LEADER]: Becoming Leader. State: Replica: fa208d6e5a984a5e9ef2888c2b49a681, State: Running, Role: LEADER
I20260805 22:37:33.080224 25006 consensus_queue.cc:237] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 } } peers { permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 } } peers { permanent_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 35927 } }
I20260805 22:37:33.081221 24520 catalog_manager.cc:5495] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa208d6e5a984a5e9ef2888c2b49a681 (127.19.77.129). New cstate: current_term: 1 leader_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa208d6e5a984a5e9ef2888c2b49a681" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 35927 } health_report { overall_health: HEALTHY } } }
W20260805 22:37:33.081655 24850 tablet.cc:2369] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:37:33.092875 24997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.091739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41264 (local address 127.19.77.129:35927)
0805 22:37:33.091804 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:33.091806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:33.091816 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:33.091863 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:33.091864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:33.091879 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:33.091946 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:33.092620 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:33.092621 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:33.092621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:33.092626 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:33.092642 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:33.092646 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:33.092719 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:33.092777 (+ 58us) server_negotiation.cc:299] Negotiation successful
0805 22:37:33.092792 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:37:33.095021 24937 raft_consensus.cc:1261] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190 [term 1 FOLLOWER]: Refusing update from remote peer fa208d6e5a984a5e9ef2888c2b49a681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:33.095022 24803 raft_consensus.cc:1261] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36 [term 1 FOLLOWER]: Refusing update from remote peer fa208d6e5a984a5e9ef2888c2b49a681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:33.095429 25006 consensus_queue.cc:1035] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f149e91b6c614bafa5c9a282ab004e36" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:33.095621 25008 consensus_queue.cc:1035] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da5eb22c72d44e6b4c2b1eb8912c190" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 36659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:33.098008 25011 mvcc.cc:205] Tried to move back new op lower bound from 7315330879873699840 to 7315330879817351168. Current Snapshot: MvccSnapshot[applied={T|T < 7315330879873699840}]
I20260805 22:37:33.098131 25013 mvcc.cc:205] Tried to move back new op lower bound from 7315330879873699840 to 7315330879817351168. Current Snapshot: MvccSnapshot[applied={T|T < 7315330879873699840}]
I20260805 22:37:33.098603 25012 mvcc.cc:205] Tried to move back new op lower bound from 7315330879873699840 to 7315330879817351168. Current Snapshot: MvccSnapshot[applied={T|T < 7315330879873699840}]
I20260805 22:37:33.100251 24521 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:33.100350 24521 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:33.101168 24521 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bdf16d57e43a4d8a8c75bf49a222dbc6: Sending DeleteTablet for 3 replicas of tablet ea70aef8dd8c4f5a9f368af6587e180c
I20260805 22:37:33.101681 24916 tablet_service.cc:1514] Processing DeleteTablet for tablet ea70aef8dd8c4f5a9f368af6587e180c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:33 UTC) from {username='slave'} at 127.0.0.1:49186
I20260805 22:37:33.101897 24649 tablet_service.cc:1514] Processing DeleteTablet for tablet ea70aef8dd8c4f5a9f368af6587e180c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:33 UTC) from {username='slave'} at 127.0.0.1:41254
I20260805 22:37:33.102123 25021 tablet_replica.cc:330] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: stopping tablet replica
I20260805 22:37:33.102110 24783 tablet_service.cc:1514] Processing DeleteTablet for tablet ea70aef8dd8c4f5a9f368af6587e180c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:33 UTC) from {username='slave'} at 127.0.0.1:39404
I20260805 22:37:33.102284 25022 tablet_replica.cc:330] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681: stopping tablet replica
I20260805 22:37:33.102294 25021 raft_consensus.cc:2229] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:33.102408 25021 raft_consensus.cc:2258] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:33.102414 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 24584
I20260805 22:37:33.102428 25022 raft_consensus.cc:2229] T ea70aef8dd8c4f5a9f368af6587e180c P fa208d6e5a984a5e9ef2888c2b49a681 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:33.103034 25021 ts_tablet_manager.cc:1905] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:33.105334 25021 ts_tablet_manager.cc:1918] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:33.105427 25021 log.cc:1196] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/ea70aef8dd8c4f5a9f368af6587e180c
I20260805 22:37:33.105491 25023 tablet_replica.cc:330] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: stopping tablet replica
I20260805 22:37:33.105643 25023 raft_consensus.cc:2229] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:33.105705 25021 ts_tablet_manager.cc:1939] T ea70aef8dd8c4f5a9f368af6587e180c P 1da5eb22c72d44e6b4c2b1eb8912c190: Deleting consensus metadata
I20260805 22:37:33.105787 25023 raft_consensus.cc:2258] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:33.106330 25023 ts_tablet_manager.cc:1905] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:33.106317 24507 catalog_manager.cc:4841] TS 1da5eb22c72d44e6b4c2b1eb8912c190 (127.19.77.131:36659): tablet ea70aef8dd8c4f5a9f368af6587e180c (table test-table [id=a8e474db4d8847c6945747d075759002]) successfully deleted
I20260805 22:37:33.108456 25023 ts_tablet_manager.cc:1918] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:33.108557 25023 log.cc:1196] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/ea70aef8dd8c4f5a9f368af6587e180c
I20260805 22:37:33.108835 25023 ts_tablet_manager.cc:1939] T ea70aef8dd8c4f5a9f368af6587e180c P f149e91b6c614bafa5c9a282ab004e36: Deleting consensus metadata
I20260805 22:37:33.109344 24506 catalog_manager.cc:4841] TS f149e91b6c614bafa5c9a282ab004e36 (127.19.77.130:38259): tablet ea70aef8dd8c4f5a9f368af6587e180c (table test-table [id=a8e474db4d8847c6945747d075759002]) successfully deleted
W20260805 22:37:33.111186 24506 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:35927 (error 108)
I20260805 22:37:33.111439 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 24718
I20260805 22:37:33.111729 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.111597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:35927 (local address 127.0.0.1:41270)
0805 22:37:33.111649 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:33.111687 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:35927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260805 22:37:33.112282 24506 catalog_manager.cc:4584] TS fa208d6e5a984a5e9ef2888c2b49a681 (127.19.77.129:35927): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ea70aef8dd8c4f5a9f368af6587e180c: Network error: Client connection negotiation failed: client connection to 127.19.77.129:35927: connect: Connection refused (error 111)
I20260805 22:37:33.121547 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 24852
I20260805 22:37:33.129698 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 24489
2026-08-05T22:37:33Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (727 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260805 22:37:33.151998 19766 mini_oidc.cc:152] Starting JWKS server
I20260805 22:37:33.153075 19766 webserver.cc:460] Webserver started at https://127.0.0.1:34469/ using document root <none> and password file <none>
I20260805 22:37:33.153172 19766 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 22:37:33.153383 19766 webserver.cc:460] Webserver started at http://127.0.0.1:44119/ using document root <none> and password file <none>
2026-08-05T22:37:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:33Z Disabled control of system clock
I20260805 22:37:33.163492 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:42003
--webserver_interface=127.19.77.190
--webserver_port=0
--builtin_ntp_servers=127.19.77.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:42003
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34469/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/testchainca.cert with env {}
W20260805 22:37:33.248716 25030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:33.248945 25030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:33.248971 25030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:33.250456 25030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:33.250521 25030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:33.250538 25030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:33.250552 25030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:33.250566 25030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:37:33.250581 25030 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:37:33.250592 25030 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34469/jwks.json
I20260805 22:37:33.252956 25030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:42003
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:42003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34469/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:33.253185 25030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:33.253377 25030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:33.258312 25035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:33.258302 25039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:33.258373 25036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:33.258628 25030 server_base.cc:1034] running on GCE node
I20260805 22:37:33.258903 25030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:33.259275 25030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:33.260468 25030 hybrid_clock.cc:648] HybridClock initialized: now 1785969453260450 us; error 31 us; skew 500 ppm
I20260805 22:37:33.261803 25030 webserver.cc:460] Webserver started at http://127.19.77.190:46609/ using document root <none> and password file <none>
I20260805 22:37:33.262068 25030 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:33.262140 25030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:33.262293 25030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:33.263468 25030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "97e2498aef72409283a5a6c7868c71b5"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "27122bc7ee9695cdf88d9bf2e0e28920"
server_key_iv: "9bb8367411789fd653945c9092220d1c"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.263849 25030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "97e2498aef72409283a5a6c7868c71b5"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "27122bc7ee9695cdf88d9bf2e0e28920"
server_key_iv: "9bb8367411789fd653945c9092220d1c"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.265244 25030 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:37:33.266075 25047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:33.266305 25030 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:33.266420 25030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "97e2498aef72409283a5a6c7868c71b5"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "27122bc7ee9695cdf88d9bf2e0e28920"
server_key_iv: "9bb8367411789fd653945c9092220d1c"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.266497 25030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:33.276328 25030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:33.276682 25030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:33.276849 25030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:33.281049 25030 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:42003
I20260805 22:37:33.281092 25100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:42003 every 8 connection(s)
I20260805 22:37:33.281455 25030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:33.282526 25101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:33.285030 25101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5: Bootstrap starting.
I20260805 22:37:33.285703 25101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:33.286031 25101 log.cc:824] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:33.286831 25101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5: No bootstrap required, opened a new log
I20260805 22:37:33.288825 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 25030
I20260805 22:37:33.288986 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:33.288865 25101 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e2498aef72409283a5a6c7868c71b5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42003 } }
I20260805 22:37:33.289100 25101 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:33.289165 25101 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e2498aef72409283a5a6c7868c71b5, State: Initialized, Role: FOLLOWER
I20260805 22:37:33.289234 19766 external_mini_cluster.cc:1428] Setting key 0d3801edc4bcbfe7d2a7b1d8cac8a30a
I20260805 22:37:33.289340 25101 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e2498aef72409283a5a6c7868c71b5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42003 } }
I20260805 22:37:33.289450 25101 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:33.289489 25101 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:33.289541 25101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:33.290382 25101 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e2498aef72409283a5a6c7868c71b5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42003 } }
I20260805 22:37:33.290513 25101 leader_election.cc:302] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97e2498aef72409283a5a6c7868c71b5; no voters:
I20260805 22:37:33.290704 25101 leader_election.cc:288] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:33.290735 25106 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:33.290849 25106 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [term 1 LEADER]: Becoming Leader. State: Replica: 97e2498aef72409283a5a6c7868c71b5, State: Running, Role: LEADER
I20260805 22:37:33.290994 25101 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:33.290993 25106 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e2498aef72409283a5a6c7868c71b5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42003 } }
I20260805 22:37:33.291610 25107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97e2498aef72409283a5a6c7868c71b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e2498aef72409283a5a6c7868c71b5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42003 } } }
I20260805 22:37:33.291632 25108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97e2498aef72409283a5a6c7868c71b5. Latest consensus state: current_term: 1 leader_uuid: "97e2498aef72409283a5a6c7868c71b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e2498aef72409283a5a6c7868c71b5" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42003 } } }
I20260805 22:37:33.291764 25107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:33.291867 25108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:33.292088 25115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:33.292801 25115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:33.294446 25115 catalog_manager.cc:1347] Generated new cluster ID: b68c31a40eb64775a08b70bf2722bddd
I20260805 22:37:33.294565 25115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:33.296262 25105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.289802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48806 (local address 127.19.77.190:42003)
0805 22:37:33.290031 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:33.290039 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:33.290078 (+ 39us) server_negotiation.cc:407] Connection header received
0805 22:37:33.290181 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:33.290186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:33.290251 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:33.290369 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:33.290688 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.292480 (+ 1792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.293661 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.294383 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.294515 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:33.295330 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:33.295334 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:33.295334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:33.295556 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:33.295601 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:33.295616 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:33.295898 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:33.295932 (+ 34us) server_negotiation.cc:299] Negotiation successful
0805 22:37:33.296014 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260805 22:37:33.297437 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:37:33.300390 25115 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:33.300858 25115 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:33.305183 25115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97e2498aef72409283a5a6c7868c71b5: Generated new TSK 0
I20260805 22:37:33.305346 25115 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260805 22:37:33.339063 25131 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260805 22:37:33.339247 25131 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260805 22:37:33.339805 25130 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:33.315768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42003 (local address 127.0.0.1:48820)
0805 22:37:33.315979 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:33.315995 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:33.316095 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:33.316282 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:33.316283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:33.316285 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:37:33.316353 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:33.316355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.317017 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.317018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:33.317979 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:33.317982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.318369 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.318370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:33.318436 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:33.318462 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:37:33.339369 (+ 20907us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0805 22:37:33.339481 (+ 112us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.77.190:42003: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":106,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.19.77.190:42003: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260805 22:37:33.340162 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 25030
I20260805 22:37:33.340168 25105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.315891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48820 (local address 127.19.77.190:42003)
0805 22:37:33.315948 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:33.315950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:33.316080 (+ 130us) server_negotiation.cc:407] Connection header received
0805 22:37:33.316198 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:33.316199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:33.316209 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:33.316267 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:37:33.316417 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.316905 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.318077 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.318276 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.318332 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:33.318583 (+ 251us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:37:33.339033 (+ 20450us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0805 22:37:33.340101 (+ 1068us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48820: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":28}
W20260805 22:37:33.340210 25105 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48820: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34469/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
2026-08-05T22:37:33Z chronyd exiting
I20260805 22:37:33.377935 19766 test_util.cc:175] -----------------------------------------------
I20260805 22:37:33.378023 19766 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785969428667539-19766-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (227 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260805 22:37:33.378815 19766 mini_oidc.cc:152] Starting JWKS server
I20260805 22:37:33.379580 19766 webserver.cc:460] Webserver started at https://127.0.0.1:40129/ using document root <none> and password file <none>
I20260805 22:37:33.379632 19766 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 22:37:33.379779 19766 webserver.cc:460] Webserver started at http://127.0.0.1:34681/ using document root <none> and password file <none>
2026-08-05T22:37:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:33Z Disabled control of system clock
I20260805 22:37:33.389281 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:42441
--webserver_interface=127.19.77.190
--webserver_port=0
--builtin_ntp_servers=127.19.77.148:34709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:42441
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40129/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/testchainca.cert with env {}
W20260805 22:37:33.473691 25137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:33.473974 25137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:33.474018 25137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:33.475310 25137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:33.475395 25137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:33.475418 25137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:33.475441 25137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:33.475471 25137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:37:33.475494 25137 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:37:33.475520 25137 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40129/jwks.json
I20260805 22:37:33.477221 25137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:34709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:42441
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:42441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40129/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:33.477556 25137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:33.477818 25137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:33.483201 25144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:33.483237 25146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:33.483446 25137 server_base.cc:1034] running on GCE node
W20260805 22:37:33.483237 25143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:33.483872 25137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:33.484153 25137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:33.485364 25137 hybrid_clock.cc:648] HybridClock initialized: now 1785969453485326 us; error 53 us; skew 500 ppm
I20260805 22:37:33.486802 25137 webserver.cc:460] Webserver started at http://127.19.77.190:46139/ using document root <none> and password file <none>
I20260805 22:37:33.487112 25137 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:33.487218 25137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:33.487406 25137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:33.488562 25137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "0d8c9beb226cc773610148884f6b661c"
server_key_iv: "2603549bb5dd240d4a8bd2b978c1171e"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.488950 25137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "0d8c9beb226cc773610148884f6b661c"
server_key_iv: "2603549bb5dd240d4a8bd2b978c1171e"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.490393 25137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:33.491308 25152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:33.491506 25137 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:33.491621 25137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "0d8c9beb226cc773610148884f6b661c"
server_key_iv: "2603549bb5dd240d4a8bd2b978c1171e"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.491710 25137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:33.509332 25137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:33.509711 25137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:33.509886 25137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:33.514204 25137 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:42441
I20260805 22:37:33.514266 25204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:42441 every 8 connection(s)
I20260805 22:37:33.514642 25137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:33.515419 25205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:33.518374 25205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1: Bootstrap starting.
I20260805 22:37:33.519006 25205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:33.519344 25205 log.cc:824] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:33.520083 25205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1: No bootstrap required, opened a new log
I20260805 22:37:33.521727 25205 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42441 } }
I20260805 22:37:33.521867 25205 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:33.521890 25205 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5a6f97fa8f40c7bf8f7d09b9c051a1, State: Initialized, Role: FOLLOWER
I20260805 22:37:33.522076 25205 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42441 } }
I20260805 22:37:33.522158 25205 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:33.522193 25205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:33.522241 25205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:33.522964 25205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42441 } }
I20260805 22:37:33.523074 25205 leader_election.cc:302] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e5a6f97fa8f40c7bf8f7d09b9c051a1; no voters:
I20260805 22:37:33.523272 25205 leader_election.cc:288] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:33.523321 25208 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:33.523511 25208 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [term 1 LEADER]: Becoming Leader. State: Replica: 3e5a6f97fa8f40c7bf8f7d09b9c051a1, State: Running, Role: LEADER
I20260805 22:37:33.523595 25205 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:33.523662 25208 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42441 } }
I20260805 22:37:33.524031 25209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42441 } } }
I20260805 22:37:33.524159 25209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:33.524227 25210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e5a6f97fa8f40c7bf8f7d09b9c051a1. Latest consensus state: current_term: 1 leader_uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e5a6f97fa8f40c7bf8f7d09b9c051a1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42441 } } }
I20260805 22:37:33.524313 25210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:33.524399 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 25137
I20260805 22:37:33.524438 25213 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:33.524513 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:33.524736 19766 external_mini_cluster.cc:1428] Setting key 27a6b1c10846ed594b2b62a265414c36
I20260805 22:37:33.524986 25213 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:33.526916 25213 catalog_manager.cc:1347] Generated new cluster ID: e08335f092854089b656235f05ff6e38
I20260805 22:37:33.526975 25213 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:33.531692 25226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.525391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53674 (local address 127.19.77.190:42441)
0805 22:37:33.525590 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:33.525599 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:33.525948 (+ 349us) server_negotiation.cc:407] Connection header received
0805 22:37:33.526066 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:33.526074 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:33.526142 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:33.526269 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:33.526624 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.528008 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.529055 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.529640 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.529748 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:33.530778 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:33.530782 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:33.530782 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:33.530994 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:33.531035 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:33.531049 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:33.531100 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:33.531373 (+ 273us) server_negotiation.cc:299] Negotiation successful
0805 22:37:33.531464 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260805 22:37:33.532442 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:37:33.541843 25213 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:33.542562 25213 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:33.551891 25213 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e5a6f97fa8f40c7bf8f7d09b9c051a1: Generated new TSK 0
I20260805 22:37:33.552132 25213 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260805 22:37:33.579913 25236 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260805 22:37:33.580340 25236 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260805 22:37:33.580394 25226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.564511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53688 (local address 127.19.77.190:42441)
0805 22:37:33.564580 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:33.564583 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:33.564676 (+ 93us) server_negotiation.cc:407] Connection header received
0805 22:37:33.564733 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:33.564735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:33.564748 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:33.564844 (+ 96us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:37:33.564973 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.565816 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.566595 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.566913 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.566991 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:33.567265 (+ 274us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:37:33.580143 (+ 12878us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40129/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0805 22:37:33.580319 (+ 176us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53688: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40129/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":40}
W20260805 22:37:33.580559 25226 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53688: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40129/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260805 22:37:33.580586 25235 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:33.564381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42441 (local address 127.0.0.1:53688)
0805 22:37:33.564605 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:33.564615 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:33.564673 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:33.564850 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:33.564850 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:33.564852 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:37:33.564906 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:33.564908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.565903 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.565903 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:33.566504 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:33.566506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.567024 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.567026 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:33.567075 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:33.567081 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:37:33.580306 (+ 13225us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40129/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0805 22:37:33.580471 (+ 165us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.77.190:42441: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40129/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":139,"threads_started":1}
I20260805 22:37:33.581046 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 25137
2026-08-05T22:37:33Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (241 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260805 22:37:33.620528 19766 mini_oidc.cc:152] Starting JWKS server
I20260805 22:37:33.621260 19766 webserver.cc:460] Webserver started at https://127.0.0.1:43357/ using document root <none> and password file <none>
I20260805 22:37:33.621306 19766 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 22:37:33.621498 19766 webserver.cc:460] Webserver started at http://127.0.0.1:45833/ using document root <none> and password file <none>
2026-08-05T22:37:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:33Z Disabled control of system clock
I20260805 22:37:33.630445 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34429
--webserver_interface=127.19.77.190
--webserver_port=0
--builtin_ntp_servers=127.19.77.148:42717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:34429
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43357/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260805 22:37:33.714264 25242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:33.714484 25242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:33.714507 25242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:33.715749 25242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:33.715797 25242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:33.715811 25242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:33.715823 25242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:33.715837 25242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:37:33.715848 25242 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:37:33.715859 25242 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43357/jwks.json
I20260805 22:37:33.717190 25242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:42717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:34429
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43357/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:33.717407 25242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:33.717666 25242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:33.722828 25247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:33.722852 25248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:33.722875 25250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:33.723268 25242 server_base.cc:1034] running on GCE node
I20260805 22:37:33.723543 25242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:33.723846 25242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:33.724996 25242 hybrid_clock.cc:648] HybridClock initialized: now 1785969453724970 us; error 42 us; skew 500 ppm
I20260805 22:37:33.726332 25242 webserver.cc:460] Webserver started at http://127.19.77.190:41219/ using document root <none> and password file <none>
I20260805 22:37:33.726589 25242 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:33.726637 25242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:33.726812 25242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:33.728008 25242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "40d6301001454b1291aa47d37b32bdfc"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "2906dddc930f5d1d8219df80c3233fe0"
server_key_iv: "73b77f421967a9553cdb742281c7f515"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.728454 25242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "40d6301001454b1291aa47d37b32bdfc"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "2906dddc930f5d1d8219df80c3233fe0"
server_key_iv: "73b77f421967a9553cdb742281c7f515"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.730736 25242 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260805 22:37:33.731739 25257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:33.731956 25242 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:37:33.732066 25242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "40d6301001454b1291aa47d37b32bdfc"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "2906dddc930f5d1d8219df80c3233fe0"
server_key_iv: "73b77f421967a9553cdb742281c7f515"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.732151 25242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:33.746542 25242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:33.746901 25242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:33.747071 25242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:33.751590 25242 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:34429
I20260805 22:37:33.751626 25311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:34429 every 8 connection(s)
I20260805 22:37:33.752048 25242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:33.752787 25312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:33.755475 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 25242
I20260805 22:37:33.755575 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:33.755774 19766 external_mini_cluster.cc:1428] Setting key 032cf7f6b9257737a833f5aae90915ca
I20260805 22:37:33.756865 25312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc: Bootstrap starting.
I20260805 22:37:33.757726 25312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:33.758072 25312 log.cc:824] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:33.758891 25312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc: No bootstrap required, opened a new log
I20260805 22:37:33.761474 25312 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40d6301001454b1291aa47d37b32bdfc" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34429 } }
I20260805 22:37:33.761626 25312 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:33.761649 25312 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d6301001454b1291aa47d37b32bdfc, State: Initialized, Role: FOLLOWER
I20260805 22:37:33.761812 25312 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40d6301001454b1291aa47d37b32bdfc" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34429 } }
I20260805 22:37:33.761899 25312 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:33.761955 25312 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:33.762007 25312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:33.762203 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.756422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52176 (local address 127.19.77.190:34429)
0805 22:37:33.756667 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:33.756675 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:33.756701 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:37:33.757194 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:33.757201 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:33.757267 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:33.757399 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:33.757684 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.758860 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.760040 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.760491 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.760595 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:33.761411 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:33.761415 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:33.761416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:33.761598 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:33.761668 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:33.761684 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:33.761760 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:33.761848 (+ 88us) server_negotiation.cc:299] Negotiation successful
0805 22:37:33.761933 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":116,"threads_started":1}
I20260805 22:37:33.762881 25312 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40d6301001454b1291aa47d37b32bdfc" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34429 } }
I20260805 22:37:33.763002 25312 leader_election.cc:302] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40d6301001454b1291aa47d37b32bdfc; no voters:
I20260805 22:37:33.763219 25312 leader_election.cc:288] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:33.763244 25317 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:33.763226 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:37:33.763365 25317 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [term 1 LEADER]: Becoming Leader. State: Replica: 40d6301001454b1291aa47d37b32bdfc, State: Running, Role: LEADER
I20260805 22:37:33.763448 25317 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40d6301001454b1291aa47d37b32bdfc" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34429 } }
I20260805 22:37:33.763496 25312 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:33.763763 25317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40d6301001454b1291aa47d37b32bdfc. Latest consensus state: current_term: 1 leader_uuid: "40d6301001454b1291aa47d37b32bdfc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40d6301001454b1291aa47d37b32bdfc" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34429 } } }
I20260805 22:37:33.763847 25317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:33.763772 25318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40d6301001454b1291aa47d37b32bdfc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40d6301001454b1291aa47d37b32bdfc" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34429 } } }
I20260805 22:37:33.764008 25318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc [sys.catalog]: This master's current role is: LEADER
W20260805 22:37:33.765223 25332 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:37:33.765290 25332 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:37:33.765558 25322 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:33.765722 25322 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:33.767452 25322 catalog_manager.cc:1347] Generated new cluster ID: c684c7bd6c994e11b34570cd9843577d
I20260805 22:37:33.767513 25322 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:33.796936 25322 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:33.797676 25322 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:33.802083 25322 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40d6301001454b1291aa47d37b32bdfc: Generated new TSK 0
I20260805 22:37:33.802282 25322 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:37:33.813262 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.809126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52192 (local address 127.19.77.190:34429)
0805 22:37:33.809189 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:33.809191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:33.809328 (+ 137us) server_negotiation.cc:407] Connection header received
0805 22:37:33.809409 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:33.809410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:33.809422 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:33.809491 (+ 69us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:37:33.809695 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.810244 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.811652 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.811877 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.811932 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:33.812152 (+ 220us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:37:33.813008 (+ 856us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43357/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0805 22:37:33.813184 (+ 176us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52192: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43357/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":33}
W20260805 22:37:33.813308 25341 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:33.809042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34429 (local address 127.0.0.1:52192)
0805 22:37:33.809240 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:33.809253 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:33.809334 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:33.809521 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:33.809522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:33.809524 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:37:33.809594 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:33.809596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.810526 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.810527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:33.811545 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:33.811548 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.811968 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.811969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:33.812030 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:33.812037 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:37:33.813114 (+ 1077us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43357/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0805 22:37:33.813215 (+ 101us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.77.190:34429: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43357/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":103,"threads_started":1}
W20260805 22:37:33.813342 25315 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52192: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43357/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260805 22:37:33.813796 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 25242
E20260805 22:37:33.823892 25342 webserver.cc:533] Webserver: sslize failed:
E20260805 22:37:33.823982 25342 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-05T22:37:33Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (232 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-05T22:37:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:33Z Disabled control of system clock
I20260805 22:37:33.862489 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:44815
--webserver_interface=127.19.77.190
--webserver_port=0
--builtin_ntp_servers=127.19.77.148:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:44815
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/testchainca.cert with env {}
W20260805 22:37:33.946039 25346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:33.946345 25346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:33.946375 25346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:33.947788 25346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:33.947850 25346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:33.947865 25346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:33.947897 25346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:33.947929 25346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:37:33.947953 25346 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:37:33.947976 25346 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260805 22:37:33.949999 25346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:44815
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:44815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:33.950320 25346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:33.950572 25346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:33.955681 25351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:33.955693 25354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:33.955693 25352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:33.955756 25346 server_base.cc:1034] running on GCE node
I20260805 22:37:33.956136 25346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:33.956454 25346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:33.957610 25346 hybrid_clock.cc:648] HybridClock initialized: now 1785969453957574 us; error 53 us; skew 500 ppm
I20260805 22:37:33.958930 25346 webserver.cc:460] Webserver started at http://127.19.77.190:44157/ using document root <none> and password file <none>
I20260805 22:37:33.959183 25346 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:33.959249 25346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:33.959345 25346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:33.960427 25346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "db0ace106df046039c2d3f8dcbd5eff6"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "919cbc151595cf3f6f198efbdd583444"
server_key_iv: "2759142611364dd4e0a7e870bbd51283"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.960767 25346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "db0ace106df046039c2d3f8dcbd5eff6"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "919cbc151595cf3f6f198efbdd583444"
server_key_iv: "2759142611364dd4e0a7e870bbd51283"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.962164 25346 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:33.962957 25360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:33.963210 25346 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:33.963312 25346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "db0ace106df046039c2d3f8dcbd5eff6"
format_stamp: "Formatted at 2026-08-05 22:37:33 on dist-test-slave-chsk"
server_key: "919cbc151595cf3f6f198efbdd583444"
server_key_iv: "2759142611364dd4e0a7e870bbd51283"
server_key_version: "encryptionkey@0"
I20260805 22:37:33.963397 25346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:33.977437 25346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:33.977826 25346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:33.977993 25346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:33.982928 25346 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:44815
I20260805 22:37:33.982991 25415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:44815 every 8 connection(s)
I20260805 22:37:33.983418 25346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:33.984575 25417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:33.986997 25417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6: Bootstrap starting.
I20260805 22:37:33.987499 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 25346
I20260805 22:37:33.987618 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:33.987833 19766 external_mini_cluster.cc:1428] Setting key bbb6963f3fbfe5154533a4d1f7721e6e
I20260805 22:37:33.987856 25417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:33.988221 25417 log.cc:824] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:33.989217 25417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6: No bootstrap required, opened a new log
I20260805 22:37:33.991904 25417 raft_consensus.cc:348] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db0ace106df046039c2d3f8dcbd5eff6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44815 } }
I20260805 22:37:33.992089 25417 raft_consensus.cc:374] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:33.992128 25417 raft_consensus.cc:729] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0ace106df046039c2d3f8dcbd5eff6, State: Initialized, Role: FOLLOWER
I20260805 22:37:33.992269 25417 consensus_queue.cc:260] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db0ace106df046039c2d3f8dcbd5eff6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44815 } }
I20260805 22:37:33.992388 25417 raft_consensus.cc:388] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:33.992435 25417 raft_consensus.cc:482] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:33.992487 25417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:33.993209 25417 raft_consensus.cc:504] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db0ace106df046039c2d3f8dcbd5eff6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44815 } }
I20260805 22:37:33.993333 25417 leader_election.cc:302] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db0ace106df046039c2d3f8dcbd5eff6; no voters:
I20260805 22:37:33.993541 25417 leader_election.cc:288] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:33.993620 25422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:33.993770 25422 raft_consensus.cc:686] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [term 1 LEADER]: Becoming Leader. State: Replica: db0ace106df046039c2d3f8dcbd5eff6, State: Running, Role: LEADER
I20260805 22:37:33.993825 25417 sys_catalog.cc:564] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:33.994257 25422 consensus_queue.cc:237] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db0ace106df046039c2d3f8dcbd5eff6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44815 } }
I20260805 22:37:33.994643 25423 sys_catalog.cc:455] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db0ace106df046039c2d3f8dcbd5eff6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db0ace106df046039c2d3f8dcbd5eff6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44815 } } }
I20260805 22:37:33.994746 25423 sys_catalog.cc:458] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:33.994822 25421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:33.988493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37600 (local address 127.19.77.190:44815)
0805 22:37:33.988719 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:33.988727 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:33.988752 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:37:33.989564 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:33.989574 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:33.989657 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:33.989824 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:33.990038 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.991575 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.992583 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:33.993011 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:33.993108 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:33.993925 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:33.993929 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:33.993929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:37:33.994120 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:33.994154 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:37:33.994165 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:33.994217 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:33.994442 (+ 225us) server_negotiation.cc:299] Negotiation successful
0805 22:37:33.994538 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":113,"threads_started":1}
I20260805 22:37:33.994890 25423 sys_catalog.cc:455] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db0ace106df046039c2d3f8dcbd5eff6. Latest consensus state: current_term: 1 leader_uuid: "db0ace106df046039c2d3f8dcbd5eff6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db0ace106df046039c2d3f8dcbd5eff6" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 44815 } } }
I20260805 22:37:33.994940 25423 sys_catalog.cc:458] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:33.995795 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260805 22:37:33.995905 25437 catalog_manager.cc:1558] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:37:33.995962 25437 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:37:33.996021 25431 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:33.996187 25431 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:33.998175 25431 catalog_manager.cc:1347] Generated new cluster ID: 549b548269b845a3af80d6cd632d999d
I20260805 22:37:33.998237 25431 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:34.011861 25431 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:34.012424 25431 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:34.017586 25431 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db0ace106df046039c2d3f8dcbd5eff6: Generated new TSK 0
I20260805 22:37:34.017813 25431 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:37:34.055280 25421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:34.028315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37608 (local address 127.19.77.190:44815)
0805 22:37:34.028367 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:34.028369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:34.028483 (+ 114us) server_negotiation.cc:407] Connection header received
0805 22:37:34.028548 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:34.028549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:34.028562 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:34.028638 (+ 76us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:37:34.028767 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:34.029598 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:34.030443 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:34.030772 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:34.030847 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:34.031030 (+ 183us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:37:34.054963 (+ 23933us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0805 22:37:34.055200 (+ 237us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37608: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":28}
W20260805 22:37:34.055372 25421 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37608: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260805 22:37:34.055514 25446 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:34.028230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:44815 (local address 127.0.0.1:37608)
0805 22:37:34.028393 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:34.028405 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:34.028473 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:34.028644 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:34.028645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:34.028646 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:37:34.028699 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:34.028700 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:34.029714 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:34.029716 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:34.030349 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:34.030351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:34.030862 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:34.030863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:34.030908 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:34.030913 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:37:34.055182 (+ 24269us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0805 22:37:34.055327 (+ 145us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.77.190:44815: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":111,"threads_started":1}
I20260805 22:37:34.055939 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 25346
2026-08-05T22:37:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (221 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (95 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (97 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:34 dist-test-slave-chsk krb5kdc[25459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:34 dist-test-slave-chsk krb5kdc[25459](info): set up 2 sockets
Aug 05 22:37:34 dist-test-slave-chsk krb5kdc[25459](info): commencing operation
krb5kdc: starting...
W20260805 22:37:35.310268 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:35 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:35.446815 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:38003
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:38003
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:35.532492 25472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:35.532757 25472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:35.532800 25472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:35.534082 25472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:35.534158 25472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:35.534185 25472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:35.534217 25472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:35.534242 25472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:35.535887 25472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:38003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:38003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:35.536196 25472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:35.536440 25472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:35.541524 25478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:35.541548 25477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:35.541642 25472 server_base.cc:1034] running on GCE node
W20260805 22:37:35.541525 25481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:35.542112 25472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:35.542441 25472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:35.543613 25472 hybrid_clock.cc:648] HybridClock initialized: now 1785969455543589 us; error 41 us; skew 500 ppm
Aug 05 22:37:35 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969455, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:35.546387 25472 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:35.546917 25472 webserver.cc:460] Webserver started at http://127.19.77.190:34183/ using document root <none> and password file <none>
I20260805 22:37:35.547231 25472 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:35.547284 25472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:35.547441 25472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:35.548992 25472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "f55f1d56a635463a80d93cb817cfa667"
format_stamp: "Formatted at 2026-08-05 22:37:35 on dist-test-slave-chsk"
server_key: "0603d53f29eaf4cb4cb25a2347ba679f"
server_key_iv: "5d66d619fc29019baa56d8a322de8908"
server_key_version: "encryptionkey@0"
I20260805 22:37:35.549405 25472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "f55f1d56a635463a80d93cb817cfa667"
format_stamp: "Formatted at 2026-08-05 22:37:35 on dist-test-slave-chsk"
server_key: "0603d53f29eaf4cb4cb25a2347ba679f"
server_key_iv: "5d66d619fc29019baa56d8a322de8908"
server_key_version: "encryptionkey@0"
I20260805 22:37:35.550890 25472 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:35.551846 25488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:35.552038 25472 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:35.552162 25472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "f55f1d56a635463a80d93cb817cfa667"
format_stamp: "Formatted at 2026-08-05 22:37:35 on dist-test-slave-chsk"
server_key: "0603d53f29eaf4cb4cb25a2347ba679f"
server_key_iv: "5d66d619fc29019baa56d8a322de8908"
server_key_version: "encryptionkey@0"
I20260805 22:37:35.552260 25472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:35.562048 25472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:35.564342 25472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:35.564540 25472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:35.568964 25472 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:38003
I20260805 22:37:35.569005 25543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:38003 every 8 connection(s)
I20260805 22:37:35.569387 25472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:35.570346 25544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:35.572845 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 25472
I20260805 22:37:35.572928 25544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667: Bootstrap starting.
I20260805 22:37:35.572983 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:35.573201 19766 external_mini_cluster.cc:1428] Setting key 2c29ff1503c0dee1669870096d904db5
I20260805 22:37:35.573638 25544 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:35.574046 25544 log.cc:824] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:35.574815 25544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667: No bootstrap required, opened a new log
I20260805 22:37:35.576815 25544 raft_consensus.cc:348] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55f1d56a635463a80d93cb817cfa667" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38003 } }
I20260805 22:37:35.577030 25544 raft_consensus.cc:374] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:35.577088 25544 raft_consensus.cc:729] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f55f1d56a635463a80d93cb817cfa667, State: Initialized, Role: FOLLOWER
I20260805 22:37:35.577252 25544 consensus_queue.cc:260] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55f1d56a635463a80d93cb817cfa667" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38003 } }
I20260805 22:37:35.577340 25544 raft_consensus.cc:388] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:35.577386 25544 raft_consensus.cc:482] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:35.577441 25544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:35.578276 25544 raft_consensus.cc:504] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55f1d56a635463a80d93cb817cfa667" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38003 } }
I20260805 22:37:35.578393 25544 leader_election.cc:302] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f55f1d56a635463a80d93cb817cfa667; no voters:
I20260805 22:37:35.578611 25544 leader_election.cc:288] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:35.578646 25550 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:35.578784 25550 raft_consensus.cc:686] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [term 1 LEADER]: Becoming Leader. State: Replica: f55f1d56a635463a80d93cb817cfa667, State: Running, Role: LEADER
I20260805 22:37:35.578883 25550 consensus_queue.cc:237] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55f1d56a635463a80d93cb817cfa667" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38003 } }
I20260805 22:37:35.578924 25544 sys_catalog.cc:564] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:35.579315 25550 sys_catalog.cc:455] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f55f1d56a635463a80d93cb817cfa667. Latest consensus state: current_term: 1 leader_uuid: "f55f1d56a635463a80d93cb817cfa667" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55f1d56a635463a80d93cb817cfa667" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38003 } } }
I20260805 22:37:35.579404 25550 sys_catalog.cc:458] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:35.579592 25551 sys_catalog.cc:455] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f55f1d56a635463a80d93cb817cfa667" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55f1d56a635463a80d93cb817cfa667" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38003 } } }
I20260805 22:37:35.580806 25551 sys_catalog.cc:458] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:35.580551 25559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 05 22:37:35 dist-test-slave-chsk krb5kdc[25459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:35.581784 25559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:35.584062 25559 catalog_manager.cc:1347] Generated new cluster ID: 5333436fe5fd4415a190141da3407b7b
I20260805 22:37:35.584149 25559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:35.586112 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:35.573808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47482 (local address 127.19.77.190:38003)
0805 22:37:35.574063 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:35.574072 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:35.574099 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:37:35.574587 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:35.574594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:35.574645 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:35.574799 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:35.575593 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:35.576518 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:35.577431 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:35.578071 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:35.578210 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:35.582217 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:35.582222 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:35.582222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:35.582243 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:35.584468 (+ 2225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:35.584887 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:35.584891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:35.584891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:35.584988 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:35.585211 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:35.585212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:35.585212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:35.585474 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:35.585653 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:35.585763 (+ 110us) server_negotiation.cc:299] Negotiation successful
0805 22:37:35.585912 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":106,"threads_started":1}
I20260805 22:37:35.605928 25559 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:35.606762 25559 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:35.611585 25559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f55f1d56a635463a80d93cb817cfa667: Generated new TSK 0
I20260805 22:37:35.611826 25559 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:37:35.644045 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38003
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:35.739912 25572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:35.740132 25572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:35.740165 25572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:35.741459 25572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:35.741508 25572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:35.741536 25572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:35.743350 25572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38003
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:35.743649 25572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:35.743892 25572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:35.749234 25577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:35.749270 25580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:35.749282 25578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:35.749570 25572 server_base.cc:1034] running on GCE node
I20260805 22:37:35.749821 25572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:35.750110 25572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:35.751232 25572 hybrid_clock.cc:648] HybridClock initialized: now 1785969455751207 us; error 45 us; skew 500 ppm
Aug 05 22:37:35 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969455, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:35.754086 25572 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:37:35.754607 25572 webserver.cc:460] Webserver started at http://127.19.77.129:44853/ using document root <none> and password file <none>
I20260805 22:37:35.754851 25572 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:35.754925 25572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:35.755098 25572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:35.756284 25572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "22fceb270fc840f3b4793059ebf61a96"
format_stamp: "Formatted at 2026-08-05 22:37:35 on dist-test-slave-chsk"
server_key: "836ad4eb896e4d71fcbdbd609982c278"
server_key_iv: "c18a90ca7ff13ef471948d3e3c243e9d"
server_key_version: "encryptionkey@0"
I20260805 22:37:35.756615 25572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "22fceb270fc840f3b4793059ebf61a96"
format_stamp: "Formatted at 2026-08-05 22:37:35 on dist-test-slave-chsk"
server_key: "836ad4eb896e4d71fcbdbd609982c278"
server_key_iv: "c18a90ca7ff13ef471948d3e3c243e9d"
server_key_version: "encryptionkey@0"
I20260805 22:37:35.758052 25572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:35.759088 25587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:35.759363 25572 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:35.759459 25572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "22fceb270fc840f3b4793059ebf61a96"
format_stamp: "Formatted at 2026-08-05 22:37:35 on dist-test-slave-chsk"
server_key: "836ad4eb896e4d71fcbdbd609982c278"
server_key_iv: "c18a90ca7ff13ef471948d3e3c243e9d"
server_key_version: "encryptionkey@0"
I20260805 22:37:35.759523 25572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:35.775480 25572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:35.778469 25572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:35.778620 25572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:35.778916 25572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:35.779397 25572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:35.779435 25572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:35.779458 25572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:35.779471 25572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:35.787490 25572 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:41405
I20260805 22:37:35.787603 25704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:41405 every 8 connection(s)
I20260805 22:37:35.788182 25572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:35.790517 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 25572
I20260805 22:37:35.790685 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:35.790906 19766 external_mini_cluster.cc:1428] Setting key a940fec1a344675bd697974ab3a8e852
Aug 05 22:37:35 dist-test-slave-chsk krb5kdc[25459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969455, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:35.800040 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:35.789570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:33301 (local address 127.19.77.190:38003)
0805 22:37:35.789677 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:35.789681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:35.790054 (+ 373us) server_negotiation.cc:407] Connection header received
0805 22:37:35.791163 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:35.791165 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:35.791182 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:35.791292 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:35.792131 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:35.792892 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:35.794049 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:35.794275 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:35.794365 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:35.796783 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:35.796785 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:35.796785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:35.796802 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:35.798385 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:35.798875 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:35.798876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:35.798877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:35.798945 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:35.799325 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:35.799326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:35.799326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:35.799457 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:35.799544 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:35.799842 (+ 298us) server_negotiation.cc:299] Negotiation successful
0805 22:37:35.799938 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:37:35.800320 25707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:35.789524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38003 (local address 127.19.77.129:33301)
0805 22:37:35.789797 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:35.789850 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:35.790976 (+ 1126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:35.791404 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:35.791408 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:35.791781 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:35.792015 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:35.792020 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:35.793012 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:35.793013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:35.793944 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:35.793947 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:35.794379 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:35.794380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:35.794515 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:35.795199 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:35.795218 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:35.796670 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:35.798523 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:35.798534 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:35.798538 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:35.798787 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:35.799057 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:35.799058 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:35.799058 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:35.799246 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:35.799527 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:35.799535 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:35.799699 (+ 164us) client_negotiation.cc:769] Sending connection context
0805 22:37:35.799822 (+ 123us) client_negotiation.cc:240] Negotiation successful
0805 22:37:35.800003 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":146,"threads_started":1}
I20260805 22:37:35.800908 25705 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38003
I20260805 22:37:35.801038 25705 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:35.801316 25705 heartbeater.cc:511] Master 127.19.77.190:38003 requested a full tablet report, sending...
I20260805 22:37:35.801998 25505 ts_manager.cc:194] Registered new tserver with Master: 22fceb270fc840f3b4793059ebf61a96 (127.19.77.129:41405)
I20260805 22:37:35.802767 25505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:33301
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:37:35.822124 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38003
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:35.909125 25710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:35.909355 25710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:35.909384 25710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:35.910806 25710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:35.910880 25710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:35.910912 25710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:35.912667 25710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38003
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:35.912971 25710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:35.913260 25710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:35.918691 25718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:35.918722 25715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:35.918746 25710 server_base.cc:1034] running on GCE node
W20260805 22:37:35.918691 25716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:35.919184 25710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:35.919492 25710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:35.920677 25710 hybrid_clock.cc:648] HybridClock initialized: now 1785969455920663 us; error 31 us; skew 500 ppm
Aug 05 22:37:35 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969455, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:35.923951 25710 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:37:35.924441 25710 webserver.cc:460] Webserver started at http://127.19.77.130:33461/ using document root <none> and password file <none>
I20260805 22:37:35.924685 25710 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:35.924757 25710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:35.924922 25710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:35.926010 25710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "3ce9d9a46a2a442f8fc3676945973d0b"
format_stamp: "Formatted at 2026-08-05 22:37:35 on dist-test-slave-chsk"
server_key: "46485d5e62aade6280a46da64b367492"
server_key_iv: "1c2ccdc2ba888eea6708e8e797e37de1"
server_key_version: "encryptionkey@0"
I20260805 22:37:35.926403 25710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "3ce9d9a46a2a442f8fc3676945973d0b"
format_stamp: "Formatted at 2026-08-05 22:37:35 on dist-test-slave-chsk"
server_key: "46485d5e62aade6280a46da64b367492"
server_key_iv: "1c2ccdc2ba888eea6708e8e797e37de1"
server_key_version: "encryptionkey@0"
I20260805 22:37:35.927901 25710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260805 22:37:35.928743 25725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:35.928938 25710 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:35.929052 25710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "3ce9d9a46a2a442f8fc3676945973d0b"
format_stamp: "Formatted at 2026-08-05 22:37:35 on dist-test-slave-chsk"
server_key: "46485d5e62aade6280a46da64b367492"
server_key_iv: "1c2ccdc2ba888eea6708e8e797e37de1"
server_key_version: "encryptionkey@0"
I20260805 22:37:35.929129 25710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:35.938313 25710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:35.940671 25710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:35.940851 25710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:35.941133 25710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:35.941468 25710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:35.941525 25710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:35.941571 25710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:35.941596 25710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:35.948304 25710 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:38247
I20260805 22:37:35.948393 25842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:38247 every 8 connection(s)
I20260805 22:37:35.948750 25710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:35.949041 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 25710
I20260805 22:37:35.949149 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:35.949360 19766 external_mini_cluster.cc:1428] Setting key 6c6277744880f448aa8e478c611c5eb8
Aug 05 22:37:35 dist-test-slave-chsk krb5kdc[25459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969455, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
I20260805 22:37:35.960234 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:35.949775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:50909 (local address 127.19.77.190:38003)
0805 22:37:35.949829 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:35.949831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:35.950134 (+ 303us) server_negotiation.cc:407] Connection header received
0805 22:37:35.951198 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:35.951199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:35.951213 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:35.951287 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:35.951988 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:35.952530 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:35.954059 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:35.954268 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:35.954327 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:35.957194 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:35.957196 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:35.957196 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:35.957205 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:35.958658 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:35.959184 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:35.959186 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:35.959186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:35.959250 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:35.959517 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:35.959518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:35.959518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:35.959654 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:35.959730 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:35.960031 (+ 301us) server_negotiation.cc:299] Negotiation successful
0805 22:37:35.960125 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:37:35.960472 25845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:35.949787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38003 (local address 127.19.77.130:50909)
0805 22:37:35.949989 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:35.950036 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:35.951034 (+ 998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:35.951348 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:35.951352 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:35.951626 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:35.951869 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:35.951875 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:35.952630 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:35.952632 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:35.953960 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:35.953964 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:35.954373 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:35.954374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:35.954531 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:35.955225 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:35.955236 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:35.957038 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:35.958791 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:35.958800 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:35.958803 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:35.959070 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:35.959322 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:35.959323 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:35.959323 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:35.959446 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:35.959734 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:35.959743 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:35.959894 (+ 151us) client_negotiation.cc:769] Sending connection context
0805 22:37:35.960019 (+ 125us) client_negotiation.cc:240] Negotiation successful
0805 22:37:35.960216 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":118,"threads_started":1}
I20260805 22:37:35.961046 25843 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38003
I20260805 22:37:35.961169 25843 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:35.961395 25843 heartbeater.cc:511] Master 127.19.77.190:38003 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
I20260805 22:37:35.961889 25505 ts_manager.cc:194] Registered new tserver with Master: 3ce9d9a46a2a442f8fc3676945973d0b (127.19.77.130:38247)
I20260805 22:37:35.962471 25505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:50909
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:37:35.978677 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38003
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:36.064118 25849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:36.064365 25849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:36.064406 25849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:36.065572 25849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:36.065649 25849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:36.065696 25849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:36.067299 25849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38003
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:36.067567 25849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:36.067813 25849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:36.073029 25857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:36.073060 25854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:36.073187 25855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:36.073243 25849 server_base.cc:1034] running on GCE node
I20260805 22:37:36.073475 25849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:36.073760 25849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:36.074920 25849 hybrid_clock.cc:648] HybridClock initialized: now 1785969456074913 us; error 43 us; skew 500 ppm
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:36.077538 25849 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:37:36.078061 25849 webserver.cc:460] Webserver started at http://127.19.77.131:37271/ using document root <none> and password file <none>
I20260805 22:37:36.078306 25849 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:36.078379 25849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:36.078541 25849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:36.079891 25849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "ea9c6280f04e4d5c97c388e902f34985"
format_stamp: "Formatted at 2026-08-05 22:37:36 on dist-test-slave-chsk"
server_key: "daf4a4af7ba47bd7069312f4f43db3f9"
server_key_iv: "aad33445a21b41068412de68c32191ee"
server_key_version: "encryptionkey@0"
I20260805 22:37:36.080318 25849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "ea9c6280f04e4d5c97c388e902f34985"
format_stamp: "Formatted at 2026-08-05 22:37:36 on dist-test-slave-chsk"
server_key: "daf4a4af7ba47bd7069312f4f43db3f9"
server_key_iv: "aad33445a21b41068412de68c32191ee"
server_key_version: "encryptionkey@0"
I20260805 22:37:36.081897 25849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:37:36.082744 25864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:36.082952 25849 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:36.083061 25849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "ea9c6280f04e4d5c97c388e902f34985"
format_stamp: "Formatted at 2026-08-05 22:37:36 on dist-test-slave-chsk"
server_key: "daf4a4af7ba47bd7069312f4f43db3f9"
server_key_iv: "aad33445a21b41068412de68c32191ee"
server_key_version: "encryptionkey@0"
I20260805 22:37:36.083142 25849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:36.106031 25849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:36.108134 25849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:36.108314 25849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:36.108577 25849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:36.108908 25849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:36.108963 25849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:36.108999 25849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:36.109046 25849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:36.115465 25849 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:34443
I20260805 22:37:36.115510 25982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:34443 every 8 connection(s)
I20260805 22:37:36.115852 25849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:36.125432 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 25849
I20260805 22:37:36.125541 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:36.125739 19766 external_mini_cluster.cc:1428] Setting key f0de8e85518e51fd2cb938dede1799d3
I20260805 22:37:36.125876 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:36.116563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:32865 (local address 127.19.77.190:38003)
0805 22:37:36.116628 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:36.116630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:36.116902 (+ 272us) server_negotiation.cc:407] Connection header received
0805 22:37:36.117903 (+ 1001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:36.117905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:36.117918 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:36.117984 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:36.118670 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:36.119257 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:36.120283 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:36.120496 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:36.120576 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:36.122885 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:36.122887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:36.122887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:36.122894 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:36.124345 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:36.124797 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:36.124798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:36.124798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:36.124852 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:36.125097 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:36.125098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:36.125098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:36.125209 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:36.125271 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:36.125677 (+ 406us) server_negotiation.cc:299] Negotiation successful
0805 22:37:36.125754 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:37:36.126113 25985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:36.116532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38003 (local address 127.19.77.131:32865)
0805 22:37:36.116736 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:36.116800 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:36.117783 (+ 983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:36.118057 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:36.118061 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:36.118347 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:36.118546 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:36.118550 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:36.119361 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:36.119362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:36.120182 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:36.120184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:36.120587 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:36.120588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:36.120723 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:36.121290 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:36.121298 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:36.122770 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:36.124473 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:36.124482 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:36.124484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:36.124729 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:36.124913 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:36.124914 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:36.124914 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:36.125034 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:36.125304 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:36.125313 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:36.125498 (+ 185us) client_negotiation.cc:769] Sending connection context
0805 22:37:36.125651 (+ 153us) client_negotiation.cc:240] Negotiation successful
0805 22:37:36.125841 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":108,"threads_started":1}
I20260805 22:37:36.126591 25983 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38003
I20260805 22:37:36.126717 25983 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:36.126902 25983 heartbeater.cc:511] Master 127.19.77.190:38003 requested a full tablet report, sending...
I20260805 22:37:36.127317 25505 ts_manager.cc:194] Registered new tserver with Master: ea9c6280f04e4d5c97c388e902f34985 (127.19.77.131:34443)
I20260805 22:37:36.127718 25505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:32865
I20260805 22:37:36.137668 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/test-admin.keytab.
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:36.156924 19766 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260805 22:37:36.158696 25990 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:36.157832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51354 (local address 127.19.77.129:41405)
0805 22:37:36.158012 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:36.158018 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:36.158038 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:37:36.158066 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:36.158068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:36.158082 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:36.158157 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:36.158611 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51354: BlockingRecv error: recv got EOF from 127.0.0.1:51354 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":104,"threads_started":1}
W20260805 22:37:36.158842 19766 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5cc' of type FILE
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:36.159945 19766 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:36.160883 19766 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:37:36.169050 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:36.161446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51360 (local address 127.19.77.129:41405)
0805 22:37:36.161511 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:36.161513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:36.161568 (+ 55us) server_negotiation.cc:407] Connection header received
0805 22:37:36.161616 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:36.161617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:36.161627 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:36.161672 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:36.162129 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:36.162929 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:36.163703 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:36.164021 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:36.164083 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:36.166314 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:36.166323 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:36.166323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:36.166330 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:36.167963 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:36.168318 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:36.168321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:36.168321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:36.168375 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:36.168601 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:36.168601 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:36.168602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:36.168730 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:36.168843 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:36.168904 (+ 61us) server_negotiation.cc:299] Negotiation successful
0805 22:37:36.168969 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260805 22:37:36.171011 25990 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:36.170443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51364 (local address 127.19.77.129:41405)
0805 22:37:36.170483 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:36.170485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:36.170556 (+ 71us) server_negotiation.cc:407] Connection header received
0805 22:37:36.170598 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:36.170599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:36.170609 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:36.170653 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:36.170975 (+ 322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51364: BlockingRecv error: recv got EOF from 127.0.0.1:51364 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260805 22:37:36.171082 19766 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5cc' of type FILE
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:36.172128 19766 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:36.172966 19766 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:37:36.180042 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:36.173477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51378 (local address 127.19.77.129:41405)
0805 22:37:36.173547 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:36.173548 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:36.173557 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:36.173607 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:36.173608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:36.173615 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:36.173659 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:36.173975 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:36.174464 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:36.175202 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:36.175440 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:36.175508 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:36.177553 (+ 2045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:36.177554 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:36.177555 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:36.177561 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:36.178997 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:36.179367 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:36.179368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:36.179369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:36.179421 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:36.179569 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:36.179569 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:36.179569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:36.179682 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:36.179753 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:36.179836 (+ 83us) server_negotiation.cc:299] Negotiation successful
0805 22:37:36.179955 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260805 22:37:36.181954 25990 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:36.181337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51382 (local address 127.19.77.129:41405)
0805 22:37:36.181397 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:36.181399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:36.181450 (+ 51us) server_negotiation.cc:407] Connection header received
0805 22:37:36.181520 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:36.181522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:36.181531 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:36.181598 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:36.181891 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51382: BlockingRecv error: recv got EOF from 127.0.0.1:51382 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260805 22:37:36.182096 19766 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785969428667539-19766-0/krb5kdc/krb5cc' of type FILE
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:36.183188 19766 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:36.184131 19766 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[25459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:37:36.192211 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:36.184711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51384 (local address 127.19.77.129:41405)
0805 22:37:36.184778 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:36.184779 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:36.184789 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:36.184930 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:36.184931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:36.184944 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:36.184997 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:36.185453 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:36.185936 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:36.186791 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:36.186976 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:36.187031 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:36.189126 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:36.189128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:36.189129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:36.189141 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:36.190947 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:36.191415 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:36.191417 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:36.191417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:36.191478 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:36.191695 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:36.191696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:36.191696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:36.191806 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:36.191906 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:36.192026 (+ 120us) server_negotiation.cc:299] Negotiation successful
0805 22:37:36.192105 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260805 22:37:36.192847 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 25572
I20260805 22:37:36.199628 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 25710
I20260805 22:37:36.206156 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 25849
I20260805 22:37:36.212977 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 25472
2026-08-05T22:37:36Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1966 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[26004](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[26004](info): set up 2 sockets
Aug 05 22:37:36 dist-test-slave-chsk krb5kdc[26004](info): commencing operation
krb5kdc: starting...
W20260805 22:37:37.276182 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:37 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:37Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.190.keytab.
Entry for principal oryx/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.190.keytab.
I20260805 22:37:37.412477 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:40041
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.190.keytab
--principal=oryx/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:40041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:37.499212 26018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:37.499434 26018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:37.499462 26018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:37.500676 26018 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:37.500730 26018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:37.500744 26018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:37.500756 26018 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:37.500769 26018 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:37.502390 26018 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:40041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.190.keytab
--principal=oryx/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:40041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:37.502673 26018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:37.502940 26018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:37.508042 26023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:37.508042 26024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:37.508061 26026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:37.508096 26018 server_base.cc:1034] running on GCE node
I20260805 22:37:37.508584 26018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:37.508947 26018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:37.510113 26018 hybrid_clock.cc:648] HybridClock initialized: now 1785969457510100 us; error 34 us; skew 500 ppm
Aug 05 22:37:37 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:37.512813 26018 init.cc:377] Logged in from keytab as oryx/127.19.77.190@KRBTEST.COM (short username oryx)
I20260805 22:37:37.513283 26018 webserver.cc:460] Webserver started at http://127.19.77.190:37261/ using document root <none> and password file <none>
I20260805 22:37:37.513548 26018 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:37.513621 26018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:37.513777 26018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:37.514935 26018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "cd5c36938be54affa462f603439e1e76"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "6d94322e17f4c0745d9375ee5e1fd800"
server_key_iv: "ef2e0193e0ea8d38999c1638168a68f6"
server_key_version: "encryptionkey@0"
I20260805 22:37:37.515342 26018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "cd5c36938be54affa462f603439e1e76"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "6d94322e17f4c0745d9375ee5e1fd800"
server_key_iv: "ef2e0193e0ea8d38999c1638168a68f6"
server_key_version: "encryptionkey@0"
I20260805 22:37:37.516801 26018 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:37.518043 26033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:37.518285 26018 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:37.518405 26018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "cd5c36938be54affa462f603439e1e76"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "6d94322e17f4c0745d9375ee5e1fd800"
server_key_iv: "ef2e0193e0ea8d38999c1638168a68f6"
server_key_version: "encryptionkey@0"
I20260805 22:37:37.518501 26018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:37.532464 26018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:37.534701 26018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:37.534891 26018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:37.539179 26018 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:40041
I20260805 22:37:37.539248 26087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:40041 every 8 connection(s)
I20260805 22:37:37.539639 26018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:37.540756 26088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:37.543289 26088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76: Bootstrap starting.
I20260805 22:37:37.543926 26088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:37.544260 26088 log.cc:824] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:37.545042 26088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76: No bootstrap required, opened a new log
I20260805 22:37:37.546878 26088 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } }
I20260805 22:37:37.547122 26088 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:37.547200 26088 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd5c36938be54affa462f603439e1e76, State: Initialized, Role: FOLLOWER
I20260805 22:37:37.547415 26088 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } }
I20260805 22:37:37.547533 26088 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:37.547581 26088 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:37.547641 26088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:37.548547 26088 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } }
I20260805 22:37:37.548676 26088 leader_election.cc:302] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd5c36938be54affa462f603439e1e76; no voters:
I20260805 22:37:37.548702 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 26018
I20260805 22:37:37.548820 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:37.548898 26088 leader_election.cc:288] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:37.548977 26091 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:37.549070 19766 external_mini_cluster.cc:1428] Setting key 47be18043ddeea5e77b95fc47435f22a
I20260805 22:37:37.549190 26088 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:37.549237 26091 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 1 LEADER]: Becoming Leader. State: Replica: cd5c36938be54affa462f603439e1e76, State: Running, Role: LEADER
I20260805 22:37:37.549345 26091 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } }
I20260805 22:37:37.549748 26091 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd5c36938be54affa462f603439e1e76. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } }
I20260805 22:37:37.549826 26091 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:37.549758 26092 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } }
I20260805 22:37:37.549877 26092 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:37.550252 26102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:37.550799 26102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:37.552538 26102 catalog_manager.cc:1347] Generated new cluster ID: c0e18ddd226d444bb71ec60381e37009
I20260805 22:37:37.552597 26102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:37:37 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:37.560384 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:37.549757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37322 (local address 127.19.77.190:40041)
0805 22:37:37.550237 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:37.550247 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:37.550282 (+ 35us) server_negotiation.cc:407] Connection header received
0805 22:37:37.550405 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:37.550413 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:37.550483 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:37.550660 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:37.551727 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:37.552964 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:37.553741 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:37.554194 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:37.554322 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:37.556867 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:37.556887 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:37.556887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:37.556900 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:37.558690 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:37.559084 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:37.559087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:37.559088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:37.559259 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:37.559484 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:37.559485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:37.559485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:37.559763 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:37.559968 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:37.560040 (+ 72us) server_negotiation.cc:299] Negotiation successful
0805 22:37:37.560188 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":355,"threads_started":1}
I20260805 22:37:37.577500 26102 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:37.579074 26102 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:37.584688 26102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76: Generated new TSK 0
I20260805 22:37:37.584939 26102 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab.
Entry for principal oryx/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab.
I20260805 22:37:37.622225 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40041
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab
--principal=oryx/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:37.746039 26115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:37.746274 26115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:37.746302 26115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:37.747668 26115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:37.747722 26115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:37.747752 26115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:37.749396 26115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab
--principal=oryx/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:37.749671 26115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:37.749948 26115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:37.755493 26122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:37.755506 26121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:37.755505 26124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:37.755751 26115 server_base.cc:1034] running on GCE node
I20260805 22:37:37.755980 26115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:37.756263 26115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:37.757437 26115 hybrid_clock.cc:648] HybridClock initialized: now 1785969457757413 us; error 37 us; skew 500 ppm
Aug 05 22:37:37 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:37.763743 26115 init.cc:377] Logged in from keytab as oryx/127.19.77.129@KRBTEST.COM (short username oryx)
I20260805 22:37:37.764261 26115 webserver.cc:460] Webserver started at http://127.19.77.129:42079/ using document root <none> and password file <none>
I20260805 22:37:37.764504 26115 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:37.764578 26115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:37.764752 26115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:37.765906 26115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "a19182e80491476cb34da91f489f1d23"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "0a10ae40d86609dfb03988cc8dffd9d7"
server_key_iv: "e7daa199f3aa3b358601188f5ede354d"
server_key_version: "encryptionkey@0"
I20260805 22:37:37.766306 26115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "a19182e80491476cb34da91f489f1d23"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "0a10ae40d86609dfb03988cc8dffd9d7"
server_key_iv: "e7daa199f3aa3b358601188f5ede354d"
server_key_version: "encryptionkey@0"
I20260805 22:37:37.767887 26115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:37.769030 26131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:37.769296 26115 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:37.769428 26115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "a19182e80491476cb34da91f489f1d23"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "0a10ae40d86609dfb03988cc8dffd9d7"
server_key_iv: "e7daa199f3aa3b358601188f5ede354d"
server_key_version: "encryptionkey@0"
I20260805 22:37:37.769501 26115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:37.786316 26115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:37.788897 26115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:37.789072 26115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:37.789300 26115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:37.789629 26115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:37.789700 26115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:37.789739 26115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:37.789772 26115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:37.796161 26115 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:36955
I20260805 22:37:37.796257 26248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:36955 every 8 connection(s)
I20260805 22:37:37.796603 26115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:37.800033 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 26115
I20260805 22:37:37.800180 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:37.800370 19766 external_mini_cluster.cc:1428] Setting key 203a846af24c23f59a13a2e6a7d5f3fd
Aug 05 22:37:37 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:37.809118 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:37.797417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:33633 (local address 127.19.77.190:40041)
0805 22:37:37.797506 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:37.797509 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:37.797663 (+ 154us) server_negotiation.cc:407] Connection header received
0805 22:37:37.798224 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:37.798226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:37.798242 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:37.798306 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:37.799343 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:37.799904 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:37.801360 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:37.801697 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:37.801791 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:37.805150 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:37.805151 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:37.805152 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:37.805160 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:37.807112 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:37.807853 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:37.807854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:37.807854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:37.807949 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:37.808325 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:37.808327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:37.808327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:37.808481 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:37.808550 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:37.808935 (+ 385us) server_negotiation.cc:299] Negotiation successful
0805 22:37:37.809028 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260805 22:37:37.809415 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:37.797370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.129:33633)
0805 22:37:37.797542 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:37.797580 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:37.798103 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:37.798358 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:37.798361 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:37.798964 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:37.799250 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:37.799256 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:37.800015 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:37.800039 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:37.801246 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:37.801250 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:37.801887 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:37.801889 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:37.802116 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:37.802904 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:37.802915 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:37.805005 (+ 2090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:37.807288 (+ 2283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:37.807304 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:37.807306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:37.807733 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:37.808028 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:37.808029 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:37.808030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:37.808223 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:37.808570 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:37.808578 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:37.808772 (+ 194us) client_negotiation.cc:769] Sending connection context
0805 22:37:37.808908 (+ 136us) client_negotiation.cc:240] Negotiation successful
0805 22:37:37.809119 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":103,"threads_started":1}
I20260805 22:37:37.810022 26249 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40041
I20260805 22:37:37.810151 26249 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:37.810359 26249 heartbeater.cc:511] Master 127.19.77.190:40041 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:37:37.811040 26051 ts_manager.cc:194] Registered new tserver with Master: a19182e80491476cb34da91f489f1d23 (127.19.77.129:36955)
I20260805 22:37:37.811760 26051 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:33633
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab.
Entry for principal oryx/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab.
I20260805 22:37:37.830590 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40041
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab
--principal=oryx/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:37.916196 26254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:37.916409 26254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:37.916436 26254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:37.917622 26254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:37.917670 26254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:37.917697 26254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:37.919304 26254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab
--principal=oryx/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:37.919562 26254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:37.919824 26254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:37.925067 26262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:37.925067 26260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:37.925141 26259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:37.925360 26254 server_base.cc:1034] running on GCE node
I20260805 22:37:37.925565 26254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:37.925777 26254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:37.926957 26254 hybrid_clock.cc:648] HybridClock initialized: now 1785969457926890 us; error 79 us; skew 500 ppm
Aug 05 22:37:37 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:37.929854 26254 init.cc:377] Logged in from keytab as oryx/127.19.77.130@KRBTEST.COM (short username oryx)
I20260805 22:37:37.930406 26254 webserver.cc:460] Webserver started at http://127.19.77.130:46651/ using document root <none> and password file <none>
I20260805 22:37:37.930672 26254 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:37.930747 26254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:37.930908 26254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:37.932658 26254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "5de5f09b5c0c473988f85e31b5fd71ac"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "d864b0c8cd7860ea8b2738cc32b5cc02"
server_key_iv: "a7c5aadd754148fbe68cfab3315783cd"
server_key_version: "encryptionkey@0"
I20260805 22:37:37.933167 26254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "5de5f09b5c0c473988f85e31b5fd71ac"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "d864b0c8cd7860ea8b2738cc32b5cc02"
server_key_iv: "a7c5aadd754148fbe68cfab3315783cd"
server_key_version: "encryptionkey@0"
I20260805 22:37:37.935241 26254 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260805 22:37:37.936259 26270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:37.936465 26254 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:37.936573 26254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "5de5f09b5c0c473988f85e31b5fd71ac"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "d864b0c8cd7860ea8b2738cc32b5cc02"
server_key_iv: "a7c5aadd754148fbe68cfab3315783cd"
server_key_version: "encryptionkey@0"
I20260805 22:37:37.936676 26254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:37.951829 26254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:37.954389 26254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:37.954572 26254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:37.954841 26254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:37.955236 26254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:37.955293 26254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:37.955338 26254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:37.955367 26254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:37.961824 26254 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:42385
I20260805 22:37:37.961875 26387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:42385 every 8 connection(s)
I20260805 22:37:37.962251 26254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:37.966806 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 26254
I20260805 22:37:37.966933 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:37.967119 19766 external_mini_cluster.cc:1428] Setting key f24e9ae2e7524ac0a10d12e6189fe628
Aug 05 22:37:37 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:37.973073 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:37.962984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:33239 (local address 127.19.77.190:40041)
0805 22:37:37.963036 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:37.963038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:37.963304 (+ 266us) server_negotiation.cc:407] Connection header received
0805 22:37:37.963899 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:37.963901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:37.963916 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:37.963993 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:37.965005 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:37.965519 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:37.966541 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:37.966867 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:37.966954 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:37.969732 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:37.969733 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:37.969734 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:37.969743 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:37.971329 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:37.971879 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:37.971880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:37.971880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:37.971935 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:37.972272 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:37.972274 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:37.972274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:37.972417 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:37.972487 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:37.972864 (+ 377us) server_negotiation.cc:299] Negotiation successful
0805 22:37:37.972978 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:37:37.973366 26390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:37.962960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.130:33239)
0805 22:37:37.963113 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:37.963213 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:37.963774 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:37.964065 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:37.964073 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:37.964680 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:37.964890 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:37.964895 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:37.965628 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:37.965629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:37.966444 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:37.966445 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:37.966992 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:37.966994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:37.967223 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:37.967882 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:37.967892 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:37.969630 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:37.971422 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:37.971431 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:37.971434 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:37.971796 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:37.971997 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:37.971997 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:37.971998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:37.972158 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:37.972503 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:37.972519 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:37.972714 (+ 195us) client_negotiation.cc:769] Sending connection context
0805 22:37:37.972844 (+ 130us) client_negotiation.cc:240] Negotiation successful
0805 22:37:37.973049 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260805 22:37:37.974020 26388 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40041
I20260805 22:37:37.974154 26388 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:37.974380 26388 heartbeater.cc:511] Master 127.19.77.190:40041 requested a full tablet report, sending...
I20260805 22:37:37.974864 26051 ts_manager.cc:194] Registered new tserver with Master: 5de5f09b5c0c473988f85e31b5fd71ac (127.19.77.130:42385)
I20260805 22:37:37.975342 26051 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:33239
WARNING: no policy specified for oryx/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab.
Entry for principal oryx/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab.
I20260805 22:37:37.998967 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40041
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab
--principal=oryx/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:38.087908 26393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:38.088147 26393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:38.088181 26393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:38.089432 26393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:38.089483 26393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:38.089511 26393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:38.092145 26393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab
--principal=oryx/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:38.092422 26393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:38.092649 26393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:38.098049 26398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.098028 26401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.098078 26399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:38.098333 26393 server_base.cc:1034] running on GCE node
I20260805 22:37:38.098587 26393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:38.098820 26393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:38.100028 26393 hybrid_clock.cc:648] HybridClock initialized: now 1785969458100011 us; error 51 us; skew 500 ppm
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:38.103416 26393 init.cc:377] Logged in from keytab as oryx/127.19.77.131@KRBTEST.COM (short username oryx)
I20260805 22:37:38.103945 26393 webserver.cc:460] Webserver started at http://127.19.77.131:39581/ using document root <none> and password file <none>
I20260805 22:37:38.104194 26393 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:38.104267 26393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:38.104439 26393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:38.105747 26393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "aa33225a1ad24d3cad72116a37fd7583"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "327231fee6abec54a9bd3ca939ff9eb7"
server_key_iv: "9153f4751c68651e205a48eb0169919b"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.106153 26393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "aa33225a1ad24d3cad72116a37fd7583"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "327231fee6abec54a9bd3ca939ff9eb7"
server_key_iv: "9153f4751c68651e205a48eb0169919b"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.107733 26393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:37:38.108590 26408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.108785 26393 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:38.108896 26393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "aa33225a1ad24d3cad72116a37fd7583"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "327231fee6abec54a9bd3ca939ff9eb7"
server_key_iv: "9153f4751c68651e205a48eb0169919b"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.108976 26393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:38.128451 26393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:38.130945 26393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:38.131130 26393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:38.131441 26393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:38.131788 26393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:38.131845 26393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.131891 26393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:38.131922 26393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.138002 26393 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:33791
I20260805 22:37:38.138060 26526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:33791 every 8 connection(s)
I20260805 22:37:38.138439 26393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:38.145926 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 26393
I20260805 22:37:38.146034 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:38.146273 19766 external_mini_cluster.cc:1428] Setting key 18581bd4cc81c67e8397168313d5b49d
I20260805 22:37:38.148445 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.139270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:46615 (local address 127.19.77.190:40041)
0805 22:37:38.139329 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.139332 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.139586 (+ 254us) server_negotiation.cc:407] Connection header received
0805 22:37:38.140162 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.140164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.140177 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.140241 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.141273 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.141783 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.142784 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.142981 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.143042 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.145355 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.145357 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.145357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.145364 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.147228 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.147660 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.147661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.147662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.147720 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.147923 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.147924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.147924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.148037 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.148086 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.148311 (+ 225us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.148379 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:37:38.148650 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.139296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.131:46615)
0805 22:37:38.139471 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.139511 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.140059 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.140318 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.140322 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.140932 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.141136 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.141140 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.141873 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.141874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.142691 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.142692 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.143067 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.143068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.143245 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.143798 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.143807 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.145258 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.147317 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.147327 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.147329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.147589 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.147775 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.147775 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.147776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.147871 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.148076 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.148079 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.148200 (+ 121us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.148281 (+ 81us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.148422 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":91,"threads_started":1}
I20260805 22:37:38.149199 26527 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40041
I20260805 22:37:38.149314 26527 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:38.149506 26527 heartbeater.cc:511] Master 127.19.77.190:40041 requested a full tablet report, sending...
I20260805 22:37:38.149916 26051 ts_manager.cc:194] Registered new tserver with Master: aa33225a1ad24d3cad72116a37fd7583 (127.19.77.131:33791)
I20260805 22:37:38.150312 26051 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:46615
I20260805 22:37:38.158346 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.77.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.189.keytab.
Entry for principal oryx/127.19.77.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.189.keytab.
I20260805 22:37:38.187407 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.189:37543
--webserver_interface=127.19.77.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.189.keytab
--principal=oryx/127.19.77.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:40041,127.19.77.189:37543
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:38.274003 26532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:38.274230 26532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:38.274253 26532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:38.275461 26532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:38.275508 26532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:38.275523 26532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:38.275537 26532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:38.275549 26532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:38.277086 26532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:40041,127.19.77.189:37543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.189.keytab
--principal=oryx/127.19.77.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.189:37543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.77.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
W20260805 22:37:38.277228 26532 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.77.190:40041,127.19.77.189:37543'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260805 22:37:38.277382 26532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:38.277624 26532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:38.282725 26538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.282725 26540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.282725 26537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:38.283034 26532 server_base.cc:1034] running on GCE node
I20260805 22:37:38.283367 26532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:38.283708 26532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:38.284866 26532 hybrid_clock.cc:648] HybridClock initialized: now 1785969458284844 us; error 41 us; skew 500 ppm
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:38.287606 26532 init.cc:377] Logged in from keytab as oryx/127.19.77.189@KRBTEST.COM (short username oryx)
I20260805 22:37:38.288166 26532 webserver.cc:460] Webserver started at http://127.19.77.189:44143/ using document root <none> and password file <none>
I20260805 22:37:38.288424 26532 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:38.288475 26532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:38.288617 26532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:38.289732 26532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data/instance:
uuid: "c14facf401df4ba6873cf135799be8cf"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "bf03e384f3721b0301cdc1c7a41a7d56"
server_key_iv: "d2c8732cb294249cc2e0eb153b3c595f"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.290126 26532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal/instance:
uuid: "c14facf401df4ba6873cf135799be8cf"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "bf03e384f3721b0301cdc1c7a41a7d56"
server_key_iv: "d2c8732cb294249cc2e0eb153b3c595f"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.291627 26532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:38.292466 26548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.292675 26532 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:38.292750 26532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal
uuid: "c14facf401df4ba6873cf135799be8cf"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "bf03e384f3721b0301cdc1c7a41a7d56"
server_key_iv: "d2c8732cb294249cc2e0eb153b3c595f"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.292845 26532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:38.303478 26532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:38.306001 26532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:38.306142 26532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:38.310865 26532 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.189:37543
I20260805 22:37:38.311017 26602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.189:37543 every 8 connection(s)
I20260805 22:37:38.311415 26532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
I20260805 22:37:38.312402 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:38.314152 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 26532
I20260805 22:37:38.314064 26603 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.189@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.77.189@KRBTEST.COM
I20260805 22:37:38.324342 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.314848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37326 (local address 127.19.77.190:40041)
0805 22:37:38.314928 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.314930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.315340 (+ 410us) server_negotiation.cc:407] Connection header received
0805 22:37:38.315790 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.315792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.315806 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.315886 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.316502 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.317002 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.317967 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.318172 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.318253 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.320874 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.320876 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.320877 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.320884 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.322673 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.323228 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.323229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.323230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.323298 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.323581 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.323581 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.323582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.323757 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.323837 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.324149 (+ 312us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.324246 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260805 22:37:38.324538 26606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.314803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37326)
0805 22:37:38.315210 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.315260 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.315687 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.315912 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.315915 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.316226 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.316399 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.316404 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.317121 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.317122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.317868 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.317870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.318261 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.318263 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.318404 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.319008 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.319020 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.320677 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.322777 (+ 2100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.322786 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.322788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.323098 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.323378 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.323379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.323379 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.323502 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.323840 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.323848 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.324005 (+ 157us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.324115 (+ 110us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.324285 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":89,"threads_started":1}
I20260805 22:37:38.324622 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.315007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44222 (local address 127.19.77.189:37543)
0805 22:37:38.315198 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.315208 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.315242 (+ 34us) server_negotiation.cc:407] Connection header received
0805 22:37:38.315669 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.315676 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.315697 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.315818 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.316495 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.317312 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.318102 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.318420 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.318503 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.321493 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.321502 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.321502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.321511 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.323317 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.323703 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.323707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.323707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.323767 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.323976 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.323977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.323977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.324126 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.324282 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.324372 (+ 90us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.324460 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260805 22:37:38.325289 26603 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.189@KRBTEST.COM for oryx/127.19.77.189@KRBTEST.COM
I20260805 22:37:38.332295 26606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.325610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:37543 (local address 127.0.0.1:44238)
0805 22:37:38.325659 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.325670 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.325708 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.325881 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.325882 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.326011 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.326064 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.326065 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.326692 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.326693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.327272 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.327274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.327648 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.327649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.327707 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.328131 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.328135 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.329516 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.331357 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.331359 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.331359 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.331537 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.331724 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.331724 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.331725 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.331778 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.331985 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.331985 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.332024 (+ 39us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.332076 (+ 52us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.332193 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":2}
I20260805 22:37:38.332341 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.325664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44238 (local address 127.19.77.189:37543)
0805 22:37:38.325788 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.325790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.325797 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:37:38.325815 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.325815 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.325824 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.325870 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.326131 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.326621 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.327348 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.327555 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.327628 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.329629 (+ 2001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.329630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.329630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.329637 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.331277 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.331614 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.331615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.331615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.331665 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.331831 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.331831 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.331832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.331933 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.331981 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.332092 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.332236 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":78,"server-negotiator.queue_time_us":109}
I20260805 22:37:38.333877 26603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: Bootstrap starting.
I20260805 22:37:38.334842 26603 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:38.335188 26603 log.cc:824] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:38.336010 26603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: No bootstrap required, opened a new log
I20260805 22:37:38.337468 26603 raft_consensus.cc:348] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } }
I20260805 22:37:38.337648 26603 raft_consensus.cc:374] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:38.337718 26603 raft_consensus.cc:729] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c14facf401df4ba6873cf135799be8cf, State: Initialized, Role: FOLLOWER
I20260805 22:37:38.337873 26603 consensus_queue.cc:260] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } }
I20260805 22:37:38.338169 26609 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } } }
I20260805 22:37:38.338241 26603 sys_catalog.cc:564] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:38.338269 26609 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:37:38.340186 26620 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:37:38.340255 26620 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:37:38.342155 26532 master_runner.cc:428] Detected that this master c14facf401df4ba6873cf135799be8cf is joining an existing cluster
I20260805 22:37:38.342248 26532 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.77.189:37543
I20260805 22:37:38.351321 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.343704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37332 (local address 127.19.77.190:40041)
0805 22:37:38.343750 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.343752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.343761 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:38.343824 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.343825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.343835 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.343886 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.344298 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.345014 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.345778 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.346002 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.346078 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.347516 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.347517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.347517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.347526 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.349743 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.350336 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.350338 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.350338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.350405 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.350621 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.350622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.350622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.350780 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.350848 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.351107 (+ 259us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.351228 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:37:38.351397 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.343443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44250 (local address 127.19.77.189:37543)
0805 22:37:38.343488 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.343490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.343648 (+ 158us) server_negotiation.cc:407] Connection header received
0805 22:37:38.343729 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.343730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.343740 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.343769 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.344221 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.344963 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.346541 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.346779 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.346834 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.348140 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.348142 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.348143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.348150 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.349932 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.350344 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.350346 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.350346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.350409 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.350759 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.350760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.350760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.350904 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.350991 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.351156 (+ 165us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.351294 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":22}
I20260805 22:37:38.351668 26626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.343415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:37543 (local address 127.0.0.1:44250)
0805 22:37:38.343564 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.343574 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.343660 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.343830 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.343830 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.344054 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.344142 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.344144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.345057 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.345058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.346444 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.346448 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.346859 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.346861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.346980 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.347518 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.347523 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.348046 (+ 523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.350039 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.350039 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.350040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.350264 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.350635 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.350635 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.350635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.350686 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.350981 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.350982 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.351022 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.351183 (+ 161us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.351539 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":264,"thread_start_us":104,"threads_started":1}
I20260805 22:37:38.352041 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.343421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37332)
0805 22:37:38.343693 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.343704 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.343755 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.343910 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.343910 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.344147 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.344216 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.344218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.345111 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.345112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.345684 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.345685 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.346107 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.346108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.346173 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.346906 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.346910 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.347380 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.349848 (+ 2468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.349849 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.349849 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.350209 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.350469 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.350470 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.350470 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.350535 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.350845 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.350846 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.350929 (+ 83us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.351027 (+ 98us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.351238 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":104,"threads_started":1}
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.190@KRBTEST.COM for oryx/127.19.77.189@KRBTEST.COM
I20260805 22:37:38.362386 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.354453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44260 (local address 127.19.77.189:37543)
0805 22:37:38.354495 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.354497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.354646 (+ 149us) server_negotiation.cc:407] Connection header received
0805 22:37:38.354733 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.354734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.354742 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.354789 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.355365 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.355829 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.356991 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.357175 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.357227 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.359609 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.359611 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.359611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.359620 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.361037 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.361470 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.361471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.361471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.361533 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.361768 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.361769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.361769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.361895 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.361983 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.362194 (+ 211us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.362281 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:37:38.362403 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.354334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:37543 (local address 127.0.0.1:44260)
0805 22:37:38.354525 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.354576 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.354657 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.354794 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.354797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.355186 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.355255 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.355258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.355915 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.355916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.356894 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.356896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.357249 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.357250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.357338 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.357873 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.357879 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.359507 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.361154 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.361163 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.361165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.361388 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.361626 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.361627 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.361627 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.361696 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.361986 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.361996 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.362055 (+ 59us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.362154 (+ 99us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.362286 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":110,"threads_started":1}
I20260805 22:37:38.363498 26051 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.77.189:37543: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c14facf401df4ba6873cf135799be8cf"
member_type: NON_VOTER
last_known_addr {
host: "127.19.77.189"
port: 37543
}
attrs {
promote: true
}
}
dest_uuid: "cd5c36938be54affa462f603439e1e76"
cas_config_opid_index: -1
I20260805 22:37:38.363855 26051 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } }
I20260805 22:37:38.364341 26630 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER c14facf401df4ba6873cf135799be8cf (127.19.77.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } } }
I20260805 22:37:38.364776 26576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:38.365537 26630 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.77.189:37543
I20260805 22:37:38.365645 26630 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } } }
I20260805 22:37:38.365724 26630 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:38.365840 26576 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Refusing update from remote peer cd5c36938be54affa462f603439e1e76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260805 22:37:38.365908 26532 master.cc:537] Master@127.19.77.189:37543 shutting down...
I20260805 22:37:38.366225 26629 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:37:38.367336 26035 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260805 22:37:38.367828 26035 consensus_peers.cc:487] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 -> Peer c14facf401df4ba6873cf135799be8cf (127.19.77.189:37543): Couldn't send request to peer c14facf401df4ba6873cf135799be8cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260805 22:37:38.369004 26532 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:38.369108 26532 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:38.369161 26532 tablet_replica.cc:330] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: stopping tablet replica
I20260805 22:37:38.382730 26532 master.cc:552] Master@127.19.77.189:37543 shutdown complete.
I20260805 22:37:38.382802 26532 master_runner.cc:305] Clearing existing system tablet
I20260805 22:37:38.382948 26532 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:38.383002 26532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:38.383853 26532 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:37:38.384435 26634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.384593 26532 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:38.384657 26532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:38.384683 26532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal
uuid: "c14facf401df4ba6873cf135799be8cf"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "bf03e384f3721b0301cdc1c7a41a7d56"
server_key_iv: "d2c8732cb294249cc2e0eb153b3c595f"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.385639 26532 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:38.387300 26532 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260805 22:37:38.387379 26532 log.cc:1196] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260805 22:37:38.387598 26532 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: Deleting consensus metadata
I20260805 22:37:38.387904 26532 master_runner.cc:315] Copying system tablet from 127.19.77.190:40041
I20260805 22:37:38.388586 26532 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: tablet copy: Beginning tablet copy session from remote peer at address 127.19.77.190:40041
I20260805 22:37:38.395231 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.388885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37334)
0805 22:37:38.389031 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.389044 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.389112 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.389256 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.389257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.389474 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.389554 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.389556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.390228 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.390229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.391165 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.391168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.391511 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.391512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.391588 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.392061 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.392066 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.392481 (+ 415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.394090 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.394091 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.394092 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.394330 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.394537 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.394538 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.394538 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.394605 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.394837 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.394838 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.394889 (+ 51us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.394963 (+ 74us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.395080 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":93,"threads_started":1}
I20260805 22:37:38.395251 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.389026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37334 (local address 127.19.77.190:40041)
0805 22:37:38.389097 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.389099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.389111 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:37:38.389182 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.389183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.389193 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.389240 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.389630 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.390138 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.391254 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.391439 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.391488 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.392577 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.392579 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.392579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.392587 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.394004 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.394412 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.394413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.394413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.394466 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.394668 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.394669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.394669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.394775 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.394825 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.395003 (+ 178us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.395073 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:37:38.395903 26072 tablet_copy_service.cc:140] P cd5c36938be54affa462f603439e1e76: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c14facf401df4ba6873cf135799be8cf ({username='oryx', principal='oryx/127.19.77.189@KRBTEST.COM'} at 127.0.0.1:37334)
I20260805 22:37:38.396023 26072 tablet_copy_service.cc:161] P cd5c36938be54affa462f603439e1e76: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c14facf401df4ba6873cf135799be8cf at {username='oryx', principal='oryx/127.19.77.189@KRBTEST.COM'} at 127.0.0.1:37334: session id = c14facf401df4ba6873cf135799be8cf-00000000000000000000000000000000
I20260805 22:37:38.396914 26072 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260805 22:37:38.397639 26532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260805 22:37:38.398761 26532 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: tablet copy: Starting download of 0 data blocks...
I20260805 22:37:38.398944 26532 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: tablet copy: Starting download of 1 WAL segments...
I20260805 22:37:38.400357 26532 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260805 22:37:38.401324 26072 tablet_copy_service.cc:342] P cd5c36938be54affa462f603439e1e76: Request end of tablet copy session c14facf401df4ba6873cf135799be8cf-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.77.189@KRBTEST.COM'} at 127.0.0.1:37334
I20260805 22:37:38.401393 26072 tablet_copy_service.cc:433] P cd5c36938be54affa462f603439e1e76: ending tablet copy session c14facf401df4ba6873cf135799be8cf-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c14facf401df4ba6873cf135799be8cf
I20260805 22:37:38.404119 26532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:38.405385 26642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.405427 26645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.405537 26643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:38.405701 26532 server_base.cc:1034] running on GCE node
I20260805 22:37:38.405803 26532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:38.405973 26532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:38.407102 26532 hybrid_clock.cc:648] HybridClock initialized: now 1785969458407095 us; error 26 us; skew 500 ppm
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:38.408718 26532 init.cc:377] Logged in from keytab as oryx/127.19.77.189@KRBTEST.COM (short username oryx)
I20260805 22:37:38.409058 26532 webserver.cc:460] Webserver started at http://127.19.77.189:46643/ using document root <none> and password file <none>
I20260805 22:37:38.409196 26532 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:38.409247 26532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:38.409902 26532 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:37:38.410502 26652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.410668 26532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:37:38.410737 26532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal
uuid: "c14facf401df4ba6873cf135799be8cf"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "bf03e384f3721b0301cdc1c7a41a7d56"
server_key_iv: "d2c8732cb294249cc2e0eb153b3c595f"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.410799 26532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:38.421140 26532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:38.423017 26532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:38.426608 26532 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.189:37543
I20260805 22:37:38.427039 26532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
I20260805 22:37:38.427474 26704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.189:37543 every 8 connection(s)
I20260805 22:37:38.428210 26706 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:37:38.428779 26706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: Bootstrap starting.
I20260805 22:37:38.432117 26706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:37:38.432349 26706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: Bootstrap complete.
I20260805 22:37:38.432550 26706 raft_consensus.cc:348] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } }
I20260805 22:37:38.432646 26706 raft_consensus.cc:729] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c14facf401df4ba6873cf135799be8cf, State: Initialized, Role: LEARNER
I20260805 22:37:38.432682 26706 consensus_queue.cc:260] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } }
I20260805 22:37:38.432891 26706 sys_catalog.cc:564] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:38.434532 26721 catalog_manager.cc:1259] Loaded cluster ID: c0e18ddd226d444bb71ec60381e37009
I20260805 22:37:38.434636 26721 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: loading cluster ID for follower catalog manager: success
I20260805 22:37:38.435375 26710 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } } }
I20260805 22:37:38.435473 26710 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: This master's current role is: LEARNER
I20260805 22:37:38.436049 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.427624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44278 (local address 127.19.77.189:37543)
0805 22:37:38.427798 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.427800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.427817 (+ 17us) server_negotiation.cc:407] Connection header received
0805 22:37:38.427839 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.427840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.427850 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.427939 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.428547 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.429296 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.430918 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.431121 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.431251 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.432695 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.432697 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.432698 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.432707 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.434670 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.435102 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.435102 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.435103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.435208 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.435437 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.435438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.435438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.435563 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.435657 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.435857 (+ 200us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.435944 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":102,"threads_started":1}
I20260805 22:37:38.436226 26721 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: acquiring CA information for follower catalog manager: success
I20260805 22:37:38.436546 26721 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
WARNING: no policy specified for oryx/127.19.77.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.188.keytab.
Entry for principal oryx/127.19.77.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.188.keytab.
I20260805 22:37:38.471379 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.188:43899
--webserver_interface=127.19.77.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.188.keytab
--principal=oryx/127.19.77.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:40041,127.19.77.189:37543,127.19.77.188:43899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:38.561199 26724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:38.561421 26724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:38.561444 26724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:38.562753 26724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:38.562808 26724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:38.562824 26724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:38.562836 26724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:38.562994 26724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:38.564931 26724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:40041,127.19.77.189:37543,127.19.77.188:43899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.188.keytab
--principal=oryx/127.19.77.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.188:43899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.77.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:38.565243 26724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:38.565524 26724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:38.570618 26732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:38.570636 26724 server_base.cc:1034] running on GCE node
W20260805 22:37:38.570595 26730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.570603 26729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:38.571079 26724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:38.571450 26724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:38.572624 26724 hybrid_clock.cc:648] HybridClock initialized: now 1785969458572590 us; error 50 us; skew 500 ppm
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:38.575606 26724 init.cc:377] Logged in from keytab as oryx/127.19.77.188@KRBTEST.COM (short username oryx)
I20260805 22:37:38.576164 26724 webserver.cc:460] Webserver started at http://127.19.77.188:43517/ using document root <none> and password file <none>
I20260805 22:37:38.576422 26724 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:38.576474 26724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:38.576647 26724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:38.577792 26724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data/instance:
uuid: "7401ed42b45540b6826dc4a5a7fd8027"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "1257bb26e27e8869413d4b74ad3728d2"
server_key_iv: "c47809ae6be9e52cd9ba139aa4ab2f2f"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.578225 26724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal/instance:
uuid: "7401ed42b45540b6826dc4a5a7fd8027"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "1257bb26e27e8869413d4b74ad3728d2"
server_key_iv: "c47809ae6be9e52cd9ba139aa4ab2f2f"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.579922 26724 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:38.580874 26740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.581218 26724 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:38.581348 26724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal
uuid: "7401ed42b45540b6826dc4a5a7fd8027"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "1257bb26e27e8869413d4b74ad3728d2"
server_key_iv: "c47809ae6be9e52cd9ba139aa4ab2f2f"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.581442 26724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:38.589087 26724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:38.591130 26724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:38.591364 26724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:38.598901 26724 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.188:43899
I20260805 22:37:38.598966 26794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.188:43899 every 8 connection(s)
I20260805 22:37:38.599480 26724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
I20260805 22:37:38.600579 26795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:38.602769 26795 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:37:38.608055 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 26724
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.188@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:38.614301 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.603882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37340 (local address 127.19.77.190:40041)
0805 22:37:38.603988 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.603990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.604158 (+ 168us) server_negotiation.cc:407] Connection header received
0805 22:37:38.604612 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.604613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.604623 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.604690 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.605452 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.606039 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.607210 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.607439 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.607514 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.610701 (+ 3187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.610703 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.610704 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.610713 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.612465 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.613077 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.613078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.613078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.613140 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.613489 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.613490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.613490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.613638 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.613706 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.614092 (+ 386us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.614208 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 22:37:38.614410 26797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.603704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37340)
0805 22:37:38.603999 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.604068 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.604528 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.604769 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.604772 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.605062 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.605267 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.605271 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.606186 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.606187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.606996 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.606998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.607565 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.607566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.607676 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.608313 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.608321 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.610573 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.612560 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.612584 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.612587 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.612988 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.613222 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.613224 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.613224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.613399 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.613721 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.613728 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.613907 (+ 179us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.614033 (+ 126us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.614173 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":214,"threads_started":1}
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.77.188@KRBTEST.COM
I20260805 22:37:38.615270 26795 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:37:38.618883 26798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.608722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33300 (local address 127.19.77.188:43899)
0805 22:37:38.608980 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.608984 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.609001 (+ 17us) server_negotiation.cc:407] Connection header received
0805 22:37:38.609020 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.609021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.609038 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.609124 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.609732 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.610555 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.611604 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.612112 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.612204 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.615447 (+ 3243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.615456 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.615457 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.615471 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.617515 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.617917 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.617921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.617921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.617985 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.618243 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.618244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.618244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.618427 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.618592 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.618691 (+ 99us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.618759 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":179,"threads_started":1}
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.188@KRBTEST.COM for oryx/127.19.77.189@KRBTEST.COM
I20260805 22:37:38.623955 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.616158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44288 (local address 127.19.77.189:37543)
0805 22:37:38.616225 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.616227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.616330 (+ 103us) server_negotiation.cc:407] Connection header received
0805 22:37:38.616399 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.616400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.616413 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.616487 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.617003 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.617509 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.618452 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.618798 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.618869 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.621305 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.621306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.621307 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.621315 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.622852 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.623239 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.623240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.623240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.623310 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.623528 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.623529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.623529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.623642 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.623698 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.623816 (+ 118us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.623888 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260805 22:37:38.623953 26797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.615720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:37543 (local address 127.0.0.1:44288)
0805 22:37:38.616261 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.616274 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.616334 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.616470 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.616470 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.616863 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.616911 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.616914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.617669 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.617670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.618368 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.618370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.618991 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.618992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.619088 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.619539 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.619543 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.621221 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.622928 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.622929 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.622930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.623097 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.623388 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.623389 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.623389 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.623464 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.623705 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.623706 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.623746 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.623800 (+ 54us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.623882 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477}
I20260805 22:37:38.624533 26795 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.188@KRBTEST.COM for oryx/127.19.77.188@KRBTEST.COM
I20260805 22:37:38.630864 26797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.624809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:43899 (local address 127.0.0.1:33308)
0805 22:37:38.624865 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.624876 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.624919 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.625036 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.625037 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.625179 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.625210 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.625211 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.625827 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.625827 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.626295 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.626297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.626684 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.626685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.626731 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.627227 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.627232 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.628425 (+ 1193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.629982 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.629983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.629983 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.630186 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.630357 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.630357 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.630357 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.630409 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.630595 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.630595 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.630632 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.630683 (+ 51us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.630763 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260805 22:37:38.630908 26798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.624858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33308 (local address 127.19.77.188:43899)
0805 22:37:38.624895 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.624897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.624905 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:37:38.624964 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.624965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.624976 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.625028 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.625282 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.625744 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.626392 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.626598 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.626686 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.628519 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.628520 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.628521 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.628527 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.629897 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.630246 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.630247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.630247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.630298 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.630450 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.630450 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.630451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.630543 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.630589 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.630701 (+ 112us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.630809 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":21}
I20260805 22:37:38.632568 26795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Bootstrap starting.
I20260805 22:37:38.633811 26795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:38.634280 26795 log.cc:824] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:38.635296 26795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: No bootstrap required, opened a new log
I20260805 22:37:38.637269 26795 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } }
I20260805 22:37:38.637403 26795 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:38.637426 26795 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7401ed42b45540b6826dc4a5a7fd8027, State: Initialized, Role: FOLLOWER
I20260805 22:37:38.637560 26795 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } }
I20260805 22:37:38.637946 26795 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:38.638259 26800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } } }
I20260805 22:37:38.638468 26800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:37:38.640857 26811 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:37:38.640940 26811 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:37:38.646106 26724 master_runner.cc:428] Detected that this master 7401ed42b45540b6826dc4a5a7fd8027 is joining an existing cluster
I20260805 22:37:38.646206 26724 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.77.188:43899
I20260805 22:37:38.657308 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.647782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37352 (local address 127.19.77.190:40041)
0805 22:37:38.647875 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.647878 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.648145 (+ 267us) server_negotiation.cc:407] Connection header received
0805 22:37:38.648229 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.648230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.648242 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.648292 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.648943 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.649727 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.651006 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.651346 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.651419 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.654134 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.654136 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.654136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.654144 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.655904 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.656397 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.656398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.656399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.656467 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.656726 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.656727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.656728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.656887 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.656964 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.657129 (+ 165us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.657205 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:37:38.657347 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.647773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37352)
0805 22:37:38.648064 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.648075 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.648159 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.648341 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.648342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.648579 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.648798 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.648801 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.649806 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.649806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.650910 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.650912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.651567 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.651569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.651684 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.653352 (+ 1668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.653357 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.653966 (+ 609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.656000 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.656001 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.656002 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.656305 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.656550 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.656551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.656552 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.656648 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.656967 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.656968 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.657011 (+ 43us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.657091 (+ 80us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.657204 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":196,"threads_started":1}
I20260805 22:37:38.657742 26798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.648249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33324 (local address 127.19.77.188:43899)
0805 22:37:38.648297 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.648299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.651323 (+ 3024us) server_negotiation.cc:407] Connection header received
0805 22:37:38.651401 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.651402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.651409 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.651434 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.652018 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.652706 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.653540 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.653725 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.653794 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.654893 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.654894 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.654894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.654900 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.656437 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.656849 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.656850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.656850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.656927 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.657117 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.657118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.657118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.657228 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.657265 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.657431 (+ 166us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.657518 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:37:38.658157 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.648382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:43899 (local address 127.0.0.1:33324)
0805 22:37:38.651261 (+ 2879us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.651272 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.651343 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.651504 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.651505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.651831 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.651907 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.651908 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.652788 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.652789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.653433 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.653435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.653806 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.653806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.653893 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.654340 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.654345 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.654788 (+ 443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.656536 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.656537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.656538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.656748 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.657001 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.657001 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.657002 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.657055 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.657303 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.657304 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.657336 (+ 32us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.657536 (+ 200us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.657607 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2855,"thread_start_us":235,"threads_started":1}
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969457, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.190@KRBTEST.COM for oryx/127.19.77.188@KRBTEST.COM
I20260805 22:37:38.671044 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 26115
I20260805 22:37:38.678165 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:36955
--local_ip_for_outbound_sockets=127.19.77.129
--tserver_master_addrs=127.19.77.190:40041
--webserver_port=42079
--webserver_interface=127.19.77.129
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab
--principal=oryx/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.77.190:40041,127.19.77.189:37543
--tserver_master_addrs=127.19.77.190:40041,127.19.77.189:37543,127.19.77.188:43899 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:37:38.679390 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.660002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:43899 (local address 127.0.0.1:33338)
0805 22:37:38.660062 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.660073 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.660129 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.660396 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.660397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.660544 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.660587 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.660590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.661476 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.661477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.662011 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.662013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.662541 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.662542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.662591 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.663081 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.663086 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.664613 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.677765 (+ 13152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.677767 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.677768 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.678293 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.678526 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.678527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.678527 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.678589 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.678875 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.678876 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.678927 (+ 51us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.678977 (+ 50us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.679115 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260805 22:37:38.679724 26798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.660190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33338 (local address 127.19.77.188:43899)
0805 22:37:38.660244 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.660246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.660254 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:37:38.660287 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.660287 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.660296 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.660359 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.660670 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.661380 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.662095 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.662462 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.662538 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.664711 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.664712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.664713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.664720 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.677645 (+ 12925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.678393 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.678394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.678394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.678454 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.678662 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.678662 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.678663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.678803 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.679508 (+ 705us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.679552 (+ 44us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.679635 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260805 22:37:38.680166 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.647823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44300 (local address 127.19.77.189:37543)
0805 22:37:38.647885 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.647888 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.648880 (+ 992us) server_negotiation.cc:407] Connection header received
0805 22:37:38.648984 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.648986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.648998 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.649028 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.649585 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.650556 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.651891 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.652157 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.652190 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.677039 (+ 24849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.677043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.677043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.677053 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.678832 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.679294 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.679295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.679295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.679355 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.679550 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.679551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.679552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.679706 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.679767 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.679993 (+ 226us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.680084 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260805 22:37:38.680583 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.647775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:37543 (local address 127.0.0.1:44300)
0805 22:37:38.648808 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.648820 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.648909 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.649092 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.649093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.649361 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.649495 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.649497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.650633 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.650634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.651788 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.651790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.652253 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.652253 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.652332 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.675783 (+ 23451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.675790 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.676892 (+ 1102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.678934 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.678935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.678935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.679208 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.679425 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.679425 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.679426 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.679485 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.679806 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.679807 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.679872 (+ 65us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.680282 (+ 410us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.680429 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":897,"mutex_wait_us":3,"thread_start_us":185,"threads_started":1}
I20260805 22:37:38.681488 26051 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.77.188:43899: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027"
member_type: NON_VOTER
last_known_addr {
host: "127.19.77.188"
port: 43899
}
attrs {
promote: true
}
}
dest_uuid: "cd5c36938be54affa462f603439e1e76"
cas_config_opid_index: 5
I20260805 22:37:38.681772 26051 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } }
I20260805 22:37:38.682178 26629 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7401ed42b45540b6826dc4a5a7fd8027 (127.19.77.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.682763 26767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:38.683423 26629 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.77.188:43899
I20260805 22:37:38.683512 26629 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.683612 26629 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:38.683878 26724 master.cc:537] Master@127.19.77.188:43899 shutting down...
I20260805 22:37:38.683993 26767 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 FOLLOWER]: Refusing update from remote peer cd5c36938be54affa462f603439e1e76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260805 22:37:38.684666 26630 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:37:38.686074 26037 consensus_peers.cc:487] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 -> Peer 7401ed42b45540b6826dc4a5a7fd8027 (127.19.77.188:43899): Couldn't send request to peer 7401ed42b45540b6826dc4a5a7fd8027. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260805 22:37:38.687312 26724 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:38.687412 26724 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:38.687460 26724 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: stopping tablet replica
I20260805 22:37:38.688270 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.682248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:37543 (local address 127.0.0.1:44310)
0805 22:37:38.682333 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.682343 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.682380 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.684726 (+ 2346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.684728 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.684730 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:38.684778 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.684780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.685768 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.685770 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.687012 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.687016 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.687966 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.687967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.688043 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.688073 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.688130 (+ 57us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.688179 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260805 22:37:38.688575 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.682452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44310 (local address 127.19.77.189:37543)
0805 22:37:38.684531 (+ 2079us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.684533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.684542 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:38.684565 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.684566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.684593 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.684657 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:38.684871 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.685675 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.687119 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.687784 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.687857 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.687926 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.688450 (+ 524us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.688498 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2053}
I20260805 22:37:38.688813 26679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 LEARNER]: Refusing update from remote peer cd5c36938be54affa462f603439e1e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260805 22:37:38.689026 26630 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260805 22:37:38.689626 26679 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7401ed42b45540b6826dc4a5a7fd8027 (127.19.77.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.690810 26822 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.690913 26822 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: This master's current role is: LEARNER
I20260805 22:37:38.691052 26710 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd5c36938be54affa462f603439e1e76. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: NON_VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: true } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.691136 26710 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: This master's current role is: LEARNER
I20260805 22:37:38.691505 26630 raft_consensus.cc:1050] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76: attempting to promote NON_VOTER c14facf401df4ba6873cf135799be8cf to VOTER
I20260805 22:37:38.691732 26630 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } }
I20260805 22:37:38.692337 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.692198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:43899 (local address 127.0.0.1:33348)
0805 22:37:38.692255 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.692304 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:43899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260805 22:37:38.692413 26679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 LEARNER]: Refusing update from remote peer cd5c36938be54affa462f603439e1e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260805 22:37:38.692579 26629 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260805 22:37:38.692821 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.692684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:43899 (local address 127.0.0.1:33354)
0805 22:37:38.692768 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.692797 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:43899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260805 22:37:38.693055 26037 consensus_peers.cc:487] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 -> Peer 7401ed42b45540b6826dc4a5a7fd8027 (127.19.77.188:43899): Couldn't send request to peer 7401ed42b45540b6826dc4a5a7fd8027. Status: Network error: Client connection negotiation failed: client connection to 127.19.77.188:43899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260805 22:37:38.693179 26629 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, c14facf401df4ba6873cf135799be8cf (127.19.77.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.693958 26629 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.694048 26629 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:38.694016 26823 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.694239 26823 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:38.694293 26679 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, c14facf401df4ba6873cf135799be8cf (127.19.77.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.695253 26710 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.695340 26710 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:37:38.701151 26724 master.cc:552] Master@127.19.77.188:43899 shutdown complete.
I20260805 22:37:38.701232 26724 master_runner.cc:305] Clearing existing system tablet
I20260805 22:37:38.701370 26724 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:38.701439 26724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:38.702111 26724 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:38.702616 26825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.702819 26724 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:38.702876 26724 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.702899 26724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal
uuid: "7401ed42b45540b6826dc4a5a7fd8027"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "1257bb26e27e8869413d4b74ad3728d2"
server_key_iv: "c47809ae6be9e52cd9ba139aa4ab2f2f"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.703790 26724 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:38.705935 26724 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260805 22:37:38.706100 26724 log.cc:1196] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260805 22:37:38.706411 26724 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Deleting consensus metadata
I20260805 22:37:38.706614 26724 master_runner.cc:315] Copying system tablet from 127.19.77.190:40041
I20260805 22:37:38.707404 26724 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: tablet copy: Beginning tablet copy session from remote peer at address 127.19.77.190:40041
I20260805 22:37:38.715385 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.707827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37360 (local address 127.19.77.190:40041)
0805 22:37:38.707874 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.707877 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.708069 (+ 192us) server_negotiation.cc:407] Connection header received
0805 22:37:38.708129 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.708130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.708143 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.708201 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.708556 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.709061 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.709812 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.710079 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.710140 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.711332 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.711334 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.711334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.711343 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.713516 (+ 2173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.714023 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.714024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.714025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.714114 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.714350 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.714351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.714351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.714593 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.714760 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.715019 (+ 259us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.715278 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:37:38.715411 26831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.707780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37360)
0805 22:37:38.707978 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.707989 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.708058 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.708219 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.708220 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.708407 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.708458 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.708460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.709153 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.709154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.709723 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.709724 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.710143 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.710144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.710211 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.710769 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.710774 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.711242 (+ 468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.713659 (+ 2417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.713662 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.713663 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.713920 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.714191 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.714192 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.714193 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.714272 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.714757 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.714759 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.714825 (+ 66us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.714980 (+ 155us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.715269 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":156,"threads_started":1}
I20260805 22:37:38.716109 26072 tablet_copy_service.cc:140] P cd5c36938be54affa462f603439e1e76: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7401ed42b45540b6826dc4a5a7fd8027 ({username='oryx', principal='oryx/127.19.77.188@KRBTEST.COM'} at 127.0.0.1:37360)
I20260805 22:37:38.716197 26072 tablet_copy_service.cc:161] P cd5c36938be54affa462f603439e1e76: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7401ed42b45540b6826dc4a5a7fd8027 at {username='oryx', principal='oryx/127.19.77.188@KRBTEST.COM'} at 127.0.0.1:37360: session id = 7401ed42b45540b6826dc4a5a7fd8027-00000000000000000000000000000000
I20260805 22:37:38.716706 26072 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260805 22:37:38.717295 26724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260805 22:37:38.718331 26724 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: tablet copy: Starting download of 0 data blocks...
I20260805 22:37:38.718511 26724 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: tablet copy: Starting download of 1 WAL segments...
I20260805 22:37:38.719363 26724 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260805 22:37:38.720268 26072 tablet_copy_service.cc:342] P cd5c36938be54affa462f603439e1e76: Request end of tablet copy session 7401ed42b45540b6826dc4a5a7fd8027-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.77.188@KRBTEST.COM'} at 127.0.0.1:37360
I20260805 22:37:38.720355 26072 tablet_copy_service.cc:433] P cd5c36938be54affa462f603439e1e76: ending tablet copy session 7401ed42b45540b6826dc4a5a7fd8027-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7401ed42b45540b6826dc4a5a7fd8027
I20260805 22:37:38.722855 26724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:38.724362 26833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.724390 26832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:38.729864 26724 server_base.cc:1034] running on GCE node
W20260805 22:37:38.730043 26835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:38.730182 26724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:38.730396 26724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:38.731532 26724 hybrid_clock.cc:648] HybridClock initialized: now 1785969458731544 us; error 48 us; skew 500 ppm
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:38.733122 26724 init.cc:377] Logged in from keytab as oryx/127.19.77.188@KRBTEST.COM (short username oryx)
I20260805 22:37:38.733466 26724 webserver.cc:460] Webserver started at http://127.19.77.188:41711/ using document root <none> and password file <none>
I20260805 22:37:38.733594 26724 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:38.733654 26724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:38.734441 26724 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:38.735083 26842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.735239 26724 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260805 22:37:38.735313 26724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal
uuid: "7401ed42b45540b6826dc4a5a7fd8027"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "1257bb26e27e8869413d4b74ad3728d2"
server_key_iv: "c47809ae6be9e52cd9ba139aa4ab2f2f"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.735384 26724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:38.745491 26724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:38.747689 26724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:38.751688 26724 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.188:43899
I20260805 22:37:38.752094 26724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
I20260805 22:37:38.752882 26895 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:37:38.753317 26895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Bootstrap starting.
I20260805 22:37:38.755861 26895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:37:38.756112 26895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Bootstrap complete.
I20260805 22:37:38.756362 26895 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } }
I20260805 22:37:38.756458 26895 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7401ed42b45540b6826dc4a5a7fd8027, State: Initialized, Role: LEARNER
I20260805 22:37:38.756506 26895 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } }
I20260805 22:37:38.756760 26895 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:38.756742 26898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:38.756979 26898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: This master's current role is: LEARNER
I20260805 22:37:38.758337 26909 catalog_manager.cc:1259] Loaded cluster ID: c0e18ddd226d444bb71ec60381e37009
I20260805 22:37:38.758431 26909 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: loading cluster ID for follower catalog manager: success
I20260805 22:37:38.759698 26909 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: acquiring CA information for follower catalog manager: success
I20260805 22:37:38.760015 26909 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:37:38.763319 26894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.188:43899 every 8 connection(s)
W20260805 22:37:38.813508 26820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:38.813858 26820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:38.813908 26820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:38.815922 26820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:38.815999 26820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:38.816051 26820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:38.818688 26820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab
--principal=oryx/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:36955
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=42079
--tserver_master_addrs=127.19.77.190:40041,127.19.77.189:37543,127.19.77.188:43899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:38.818991 26820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:38.819339 26820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:38.827301 26915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.827381 26914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.827306 26917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:38.827934 26820 server_base.cc:1034] running on GCE node
I20260805 22:37:38.828274 26820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:38.828711 26820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:38.830060 26820 hybrid_clock.cc:648] HybridClock initialized: now 1785969458830041 us; error 62 us; skew 500 ppm
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:38.834123 26820 init.cc:377] Logged in from keytab as oryx/127.19.77.129@KRBTEST.COM (short username oryx)
I20260805 22:37:38.834657 26820 webserver.cc:460] Webserver started at http://127.19.77.129:42079/ using document root <none> and password file <none>
I20260805 22:37:38.834990 26820 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:38.835186 26820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:38.837286 26820 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:37:38.838328 26925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.838601 26820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:38.838717 26820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "a19182e80491476cb34da91f489f1d23"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "0a10ae40d86609dfb03988cc8dffd9d7"
server_key_iv: "e7daa199f3aa3b358601188f5ede354d"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.839507 26820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:38.855295 26820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:38.858526 26820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:38.858719 26820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:38.859092 26820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:38.859591 26820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:38.859632 26820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.859658 26820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:38.859669 26820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.870654 26820 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:36955
I20260805 22:37:38.870805 27041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:36955 every 8 connection(s)
I20260805 22:37:38.871243 26820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:38.880412 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 26820
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:38.880594 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 26254
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.189@KRBTEST.COM
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.188@KRBTEST.COM
I20260805 22:37:38.885216 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.872273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:59009 (local address 127.19.77.190:40041)
0805 22:37:38.872334 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.872337 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.872883 (+ 546us) server_negotiation.cc:407] Connection header received
0805 22:37:38.873968 (+ 1085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.873970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.873984 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.874037 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.874873 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.875627 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.877179 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.877436 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.877515 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.881204 (+ 3689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.881206 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.881207 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.881219 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.883020 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.883942 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.883944 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.883944 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.884013 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.884285 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.884286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.884286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.884452 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.884524 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.885015 (+ 491us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.885121 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:37:38.885836 27046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.872273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.129:59009)
0805 22:37:38.872665 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.872729 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.873833 (+ 1104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.874133 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.874137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.874524 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.874768 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.874772 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.875825 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.875826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.877038 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.877041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.877535 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.877536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.877795 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.878828 (+ 1033us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.878837 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.881025 (+ 2188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.883463 (+ 2438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.883475 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.883478 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.883836 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.884087 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.884088 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.884088 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.884212 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.884552 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.884560 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.884745 (+ 185us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.885338 (+ 593us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.885562 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":70,"thread_start_us":416,"threads_started":1}
I20260805 22:37:38.885967 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.872374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:59125 (local address 127.19.77.189:37543)
0805 22:37:38.872433 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.872435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.872893 (+ 458us) server_negotiation.cc:407] Connection header received
0805 22:37:38.874054 (+ 1161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.874055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.874070 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.874128 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.875221 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.875948 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.877377 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.877665 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.877749 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.882119 (+ 4370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.882120 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.882121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.882130 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.884377 (+ 2247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.884777 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.884778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.884778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.884872 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.885111 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.885112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.885112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.885262 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.885311 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.885769 (+ 458us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.885860 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:37:38.886327 27043 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40041
I20260805 22:37:38.886441 27043 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:38.886684 27043 heartbeater.cc:511] Master 127.19.77.190:40041 requested a full tablet report, sending...
I20260805 22:37:38.887008 27050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.872274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:37543 (local address 127.19.77.129:59125)
0805 22:37:38.872815 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.872827 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.873857 (+ 1030us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.874185 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.874186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.874580 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.874771 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.874773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.876032 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.876033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.877278 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.877281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.877749 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.877750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.877849 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.878877 (+ 1028us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.878883 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.882001 (+ 3118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.884470 (+ 2469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.884471 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.884471 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.884681 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.884969 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.884970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.884970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.885033 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.885610 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.885611 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.885653 (+ 42us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.886557 (+ 904us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.886657 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":117,"thread_start_us":290,"threads_started":1}
I20260805 22:37:38.887215 26051 ts_manager.cc:194] Re-registered known tserver with Master: a19182e80491476cb34da91f489f1d23 (127.19.77.129:36955)
I20260805 22:37:38.887466 27044 heartbeater.cc:347] Connected to a master server at 127.19.77.189:37543
I20260805 22:37:38.887511 27044 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:38.887575 27044 heartbeater.cc:511] Master 127.19.77.189:37543 requested a full tablet report, sending...
I20260805 22:37:38.887753 26051 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:59009
I20260805 22:37:38.888000 26669 ts_manager.cc:194] Registered new tserver with Master: a19182e80491476cb34da91f489f1d23 (127.19.77.129:36955)
I20260805 22:37:38.889117 27048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.872438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:46101 (local address 127.19.77.188:43899)
0805 22:37:38.872752 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:38.872755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:38.872861 (+ 106us) server_negotiation.cc:407] Connection header received
0805 22:37:38.874071 (+ 1210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:38.874073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:38.874085 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:38.874187 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:38.874891 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.875616 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.877406 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.877763 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.877835 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.882542 (+ 4707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:38.882544 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:38.882544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:38.882553 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:38.885678 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.887091 (+ 1413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.887093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.887094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.887201 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:38.887521 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:38.887522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:38.887523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:38.887709 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:38.887757 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:38.888926 (+ 1169us) server_negotiation.cc:299] Negotiation successful
0805 22:37:38.889046 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":79,"threads_started":1}
I20260805 22:37:38.889166 27049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:38.872274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:43899 (local address 127.19.77.129:46101)
0805 22:37:38.872740 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:38.872750 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:38.873833 (+ 1083us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:38.874252 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:38.874252 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:38.874579 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:38.874771 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.874773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.875830 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.875830 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.877302 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:38.877304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:38.877836 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:38.877837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:38.877909 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:38.879086 (+ 1177us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:38.879091 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:38.882386 (+ 3295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:38.885898 (+ 3512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.885900 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.885900 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.886988 (+ 1088us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.887379 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:38.887380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:38.887380 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:38.887448 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:38.888747 (+ 1299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:38.888748 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:38.888792 (+ 44us) client_negotiation.cc:769] Sending connection context
0805 22:37:38.888870 (+ 78us) client_negotiation.cc:240] Negotiation successful
0805 22:37:38.889012 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"mutex_wait_us":39,"thread_start_us":169,"threads_started":1}
I20260805 22:37:38.890141 27042 heartbeater.cc:347] Connected to a master server at 127.19.77.188:43899
I20260805 22:37:38.890226 27042 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:38.890311 27042 heartbeater.cc:511] Master 127.19.77.188:43899 requested a full tablet report, sending...
I20260805 22:37:38.890718 26850 ts_manager.cc:194] Registered new tserver with Master: a19182e80491476cb34da91f489f1d23 (127.19.77.129:36955)
I20260805 22:37:38.890759 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:42385
--local_ip_for_outbound_sockets=127.19.77.130
--tserver_master_addrs=127.19.77.190:40041
--webserver_port=46651
--webserver_interface=127.19.77.130
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab
--principal=oryx/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.77.190:40041,127.19.77.189:37543
--tserver_master_addrs=127.19.77.190:40041,127.19.77.189:37543,127.19.77.188:43899 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:38.979593 27051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:38.979828 27051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:38.979856 27051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:38.981045 27051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:38.981096 27051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:38.981123 27051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:38.982671 27051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab
--principal=oryx/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:42385
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=46651
--tserver_master_addrs=127.19.77.190:40041,127.19.77.189:37543,127.19.77.188:43899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:38.982885 27051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:38.983095 27051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:37:38.988762 27051 server_base.cc:1034] running on GCE node
W20260805 22:37:38.988727 27056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.988752 27059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:38.988744 27057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:38.989280 27051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:38.989557 27051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:38.990841 27051 hybrid_clock.cc:648] HybridClock initialized: now 1785969458990820 us; error 34 us; skew 500 ppm
Aug 05 22:37:38 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:38.993793 27051 init.cc:377] Logged in from keytab as oryx/127.19.77.130@KRBTEST.COM (short username oryx)
I20260805 22:37:38.994293 27051 webserver.cc:460] Webserver started at http://127.19.77.130:46651/ using document root <none> and password file <none>
I20260805 22:37:38.994540 27051 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:38.994645 27051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:38.996272 27051 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:38.996922 27066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:38.997112 27051 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:38.997225 27051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "5de5f09b5c0c473988f85e31b5fd71ac"
format_stamp: "Formatted at 2026-08-05 22:37:37 on dist-test-slave-chsk"
server_key: "d864b0c8cd7860ea8b2738cc32b5cc02"
server_key_iv: "a7c5aadd754148fbe68cfab3315783cd"
server_key_version: "encryptionkey@0"
I20260805 22:37:38.998088 27051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:39.036496 27051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:39.039054 27051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:39.039275 27051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:39.039588 27051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:39.040477 27051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:39.040589 27051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:39.040635 27051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:39.040666 27051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:39.049010 27051 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:42385
I20260805 22:37:39.049209 27182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:42385 every 8 connection(s)
I20260805 22:37:39.049598 27051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:37:39 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.189@KRBTEST.COM
I20260805 22:37:39.057559 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 27051
I20260805 22:37:39.057742 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 26393
Aug 05 22:37:39 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.188@KRBTEST.COM
Aug 05 22:37:39 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969458, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:39.062862 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.050666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:34435 (local address 127.19.77.189:37543)
0805 22:37:39.050727 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.050730 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.051360 (+ 630us) server_negotiation.cc:407] Connection header received
0805 22:37:39.052472 (+ 1112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.052473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.052486 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.052522 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.053426 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.053938 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.055015 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.055290 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.055370 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.059543 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.059544 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.059545 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.059554 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.061290 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.061784 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.061786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.061786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.061855 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.062154 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.062155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.062155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.062289 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.062370 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.062667 (+ 297us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.062757 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:37:39.063133 27188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.050466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:37543 (local address 127.19.77.130:34435)
0805 22:37:39.051289 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.051302 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.052317 (+ 1015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.052601 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.052602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.053079 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:39.053310 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.053315 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.054060 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.054061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.054912 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.054914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.055380 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.055382 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.055510 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.056212 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:39.056220 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:39.059398 (+ 3178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:39.061408 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.061419 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.061422 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.061697 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.061931 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.061931 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.061932 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.062066 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.062360 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:39.062367 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:39.062526 (+ 159us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.062644 (+ 118us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.062830 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"mutex_wait_us":559,"thread_start_us":149,"threads_started":1}
I20260805 22:37:39.063797 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.050953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:51621 (local address 127.19.77.190:40041)
0805 22:37:39.051010 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.051013 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.051023 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:39.052443 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.052444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.052460 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.052524 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.053428 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.054206 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.055397 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.055706 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.056107 (+ 401us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.059520 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.059522 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.059523 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.059540 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.061882 (+ 2342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.062406 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.062408 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.062408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.062475 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.062731 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.062732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.062733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.062904 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.062966 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.063657 (+ 691us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.063736 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:37:39.064164 27187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.050466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.130:51621)
0805 22:37:39.050771 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.050816 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.052300 (+ 1484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.052596 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.052599 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.053109 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:39.053310 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.053316 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.054312 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.054313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.055300 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.055302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.056462 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.056463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.056548 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.056953 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:39.056958 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:39.059398 (+ 2440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:39.062023 (+ 2625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.062024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.062025 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.062302 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.062568 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.062569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.062569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.062642 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.063458 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:39.063459 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:39.063515 (+ 56us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.063609 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.063749 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":55,"thread_start_us":488,"threads_started":1}
I20260805 22:37:39.064664 27184 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40041
I20260805 22:37:39.064790 27184 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:39.065009 27184 heartbeater.cc:511] Master 127.19.77.190:40041 requested a full tablet report, sending...
I20260805 22:37:39.065490 26051 ts_manager.cc:194] Re-registered known tserver with Master: 5de5f09b5c0c473988f85e31b5fd71ac (127.19.77.130:42385)
I20260805 22:37:39.065874 26051 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:51621
I20260805 22:37:39.071477 27185 heartbeater.cc:347] Connected to a master server at 127.19.77.189:37543
I20260805 22:37:39.071565 27185 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:39.071676 27185 heartbeater.cc:511] Master 127.19.77.189:37543 requested a full tablet report, sending...
I20260805 22:37:39.071874 27048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.050794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:37933 (local address 127.19.77.188:43899)
0805 22:37:39.051019 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.051022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.051311 (+ 289us) server_negotiation.cc:407] Connection header received
0805 22:37:39.052584 (+ 1273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.052586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.052600 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.052670 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.053429 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.054213 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.055396 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.055738 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.055781 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.068225 (+ 12444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.068227 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.068227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.068236 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.069846 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.070737 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.070738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.070739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.070805 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.071089 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.071089 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.071089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.071319 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.071387 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.071600 (+ 213us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.071719 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197}
I20260805 22:37:39.072152 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.050464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:43899 (local address 127.19.77.130:37933)
0805 22:37:39.051218 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.051229 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.052300 (+ 1071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.052689 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.052690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.053125 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:39.053310 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.053316 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.054312 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.054313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.055290 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.055292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.055863 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.055864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.055926 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.056445 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:39.056452 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:39.068091 (+ 11639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:39.070020 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.070023 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.070024 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.070606 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.070894 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.070895 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.070895 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.071015 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.071391 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:39.071393 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:39.071443 (+ 50us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.071535 (+ 92us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.071772 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"mutex_wait_us":54,"thread_start_us":94,"threads_started":1}
I20260805 22:37:39.072140 26669 ts_manager.cc:194] Registered new tserver with Master: 5de5f09b5c0c473988f85e31b5fd71ac (127.19.77.130:42385)
I20260805 22:37:39.072590 27183 heartbeater.cc:347] Connected to a master server at 127.19.77.188:43899
I20260805 22:37:39.072664 27183 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:39.072723 27183 heartbeater.cc:511] Master 127.19.77.188:43899 requested a full tablet report, sending...
I20260805 22:37:39.073009 26850 ts_manager.cc:194] Registered new tserver with Master: 5de5f09b5c0c473988f85e31b5fd71ac (127.19.77.130:42385)
I20260805 22:37:39.073719 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:33791
--local_ip_for_outbound_sockets=127.19.77.131
--tserver_master_addrs=127.19.77.190:40041
--webserver_port=39581
--webserver_interface=127.19.77.131
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab
--principal=oryx/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.77.190:40041,127.19.77.189:37543
--tserver_master_addrs=127.19.77.190:40041,127.19.77.189:37543,127.19.77.188:43899 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:39.162846 27190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:39.163107 27190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:39.163152 27190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:39.164407 27190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:39.164481 27190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:39.164531 27190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:39.166105 27190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab
--principal=oryx/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:33791
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=39581
--tserver_master_addrs=127.19.77.190:40041,127.19.77.189:37543,127.19.77.188:43899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:39.166399 27190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:39.166661 27190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:39.171977 27195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:39.171942 27196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:39.172153 27190 server_base.cc:1034] running on GCE node
W20260805 22:37:39.171942 27198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:39.172680 27190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:39.172952 27190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:39.174125 27190 hybrid_clock.cc:648] HybridClock initialized: now 1785969459174098 us; error 51 us; skew 500 ppm
Aug 05 22:37:39 dist-test-slave-chsk krb5kdc[26004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969459, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:39.177583 27190 init.cc:377] Logged in from keytab as oryx/127.19.77.131@KRBTEST.COM (short username oryx)
I20260805 22:37:39.178092 27190 webserver.cc:460] Webserver started at http://127.19.77.131:39581/ using document root <none> and password file <none>
I20260805 22:37:39.178345 27190 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:39.178468 27190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:39.180135 27190 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:39.181008 27205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:39.181411 27190 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:39.181551 27190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "aa33225a1ad24d3cad72116a37fd7583"
format_stamp: "Formatted at 2026-08-05 22:37:38 on dist-test-slave-chsk"
server_key: "327231fee6abec54a9bd3ca939ff9eb7"
server_key_iv: "9153f4751c68651e205a48eb0169919b"
server_key_version: "encryptionkey@0"
I20260805 22:37:39.181977 27190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:39.201650 27190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:39.203837 27190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:39.204010 27190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:39.204257 27190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:39.204579 27190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:39.204641 27190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:39.204687 27190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:39.204711 27190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:39.210902 27190 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:33791
I20260805 22:37:39.210947 27321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:33791 every 8 connection(s)
I20260805 22:37:39.211473 27190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:37:39 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969459, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.188@KRBTEST.COM
Aug 05 22:37:39 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969459, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.189@KRBTEST.COM
I20260805 22:37:39.220266 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 27190
Aug 05 22:37:39 dist-test-slave-chsk krb5kdc[26004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969459, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:39.224710 27048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.212336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:36427 (local address 127.19.77.188:43899)
0805 22:37:39.212377 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.212379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.212738 (+ 359us) server_negotiation.cc:407] Connection header received
0805 22:37:39.213782 (+ 1044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.213783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.213794 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.213851 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.214689 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.215481 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.217088 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.217292 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.217383 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.221208 (+ 3825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.221210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.221210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.221220 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.223178 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.223700 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.223702 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.223702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.223766 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.224006 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.224007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.224007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.224149 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.224214 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.224540 (+ 326us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.224619 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:37:39.224856 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.212743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:37543 (local address 127.19.77.131:48215)
0805 22:37:39.212853 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.212863 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.213620 (+ 757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.213873 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.213875 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.214354 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:39.214570 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.214576 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.215356 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.215357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.216678 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.216681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.217069 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.217070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.217297 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.218044 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:39.218055 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:39.220631 (+ 2576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:39.222924 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.222934 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.222937 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.223341 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.223569 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.223570 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.223570 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.223714 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.224041 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:39.224048 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:39.224242 (+ 194us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.224360 (+ 118us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.224577 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":3,"thread_start_us":70,"threads_started":1}
I20260805 22:37:39.225039 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.212282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.131:36077)
0805 22:37:39.212472 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.212510 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.213597 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.213869 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.213873 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.214394 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:39.214585 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.214586 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.216784 (+ 2198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.216785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.217528 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.217531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.218032 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.218034 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.218237 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.218674 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:39.218679 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:39.221132 (+ 2453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:39.223947 (+ 2815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.223948 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.223948 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.224167 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.224379 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.224380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.224380 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.224434 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.224735 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:39.224735 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:39.224773 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.224832 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.224935 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":3,"thread_start_us":106,"threads_started":1}
I20260805 22:37:39.225348 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.212838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:48215 (local address 127.19.77.189:37543)
0805 22:37:39.212897 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.212900 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.212910 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:39.213722 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.213724 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.213736 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.213768 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.214678 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.215241 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.216773 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.216970 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.217032 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.220770 (+ 3738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.220773 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.220773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.220784 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.222817 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.223435 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.223436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.223437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.223496 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.223793 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.223794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.223794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.223949 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.224014 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.225166 (+ 1152us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.225255 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:37:39.225415 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.212271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:36077 (local address 127.19.77.190:40041)
0805 22:37:39.212329 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.212331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.212602 (+ 271us) server_negotiation.cc:407] Connection header received
0805 22:37:39.213712 (+ 1110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.213714 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.213728 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.213782 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.214690 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.215481 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.217663 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.217904 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.218004 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.221227 (+ 3223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.221228 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.221229 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.221237 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.223862 (+ 2625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.224249 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.224250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.224250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.224311 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.224499 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.224500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.224500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.224644 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.224708 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.225240 (+ 532us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.225322 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:37:39.225764 27324 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40041
I20260805 22:37:39.225872 27324 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:39.226106 27324 heartbeater.cc:511] Master 127.19.77.190:40041 requested a full tablet report, sending...
I20260805 22:37:39.226301 27325 heartbeater.cc:347] Connected to a master server at 127.19.77.189:37543
I20260805 22:37:39.226343 27325 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:39.226406 27325 heartbeater.cc:511] Master 127.19.77.189:37543 requested a full tablet report, sending...
I20260805 22:37:39.226547 26051 ts_manager.cc:194] Re-registered known tserver with Master: aa33225a1ad24d3cad72116a37fd7583 (127.19.77.131:33791)
I20260805 22:37:39.226729 26669 ts_manager.cc:194] Registered new tserver with Master: aa33225a1ad24d3cad72116a37fd7583 (127.19.77.131:33791)
I20260805 22:37:39.227010 26051 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:36077
I20260805 22:37:39.227284 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.212282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:43899 (local address 127.19.77.131:36427)
0805 22:37:39.212634 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.212667 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.213622 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.213869 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.213873 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.214401 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:39.214574 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.214577 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.215575 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.215576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.216678 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.216681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.217385 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.217385 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.217530 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.218194 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:39.218198 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:39.221094 (+ 2896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:39.223286 (+ 2192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.223287 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.223287 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.223541 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.223860 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:39.223861 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:39.223861 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:39.223930 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:39.224244 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:39.224245 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:39.224293 (+ 48us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.224379 (+ 86us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.225821 (+ 1442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":1294,"thread_start_us":105,"threads_started":1}
I20260805 22:37:39.227998 27323 heartbeater.cc:347] Connected to a master server at 127.19.77.188:43899
I20260805 22:37:39.228050 27323 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:39.228116 27323 heartbeater.cc:511] Master 127.19.77.188:43899 requested a full tablet report, sending...
I20260805 22:37:39.228415 26850 ts_manager.cc:194] Registered new tserver with Master: aa33225a1ad24d3cad72116a37fd7583 (127.19.77.131:33791)
I20260805 22:37:39.233249 27337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.222556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33358 (local address 127.19.77.188:43899)
0805 22:37:39.222878 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.222880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.223394 (+ 514us) server_negotiation.cc:407] Connection header received
0805 22:37:39.223416 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.223417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.223430 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.223485 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.224501 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.225853 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.226894 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.227219 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.227275 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.229042 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.229043 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.229044 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.229051 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.231210 (+ 2159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.232272 (+ 1062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.232273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.232273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.232328 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.232565 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.232565 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.232566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.232691 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.232833 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.232918 (+ 85us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.233021 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":58,"threads_started":1}
I20260805 22:37:39.234478 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.222242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44318 (local address 127.19.77.189:37543)
0805 22:37:39.225451 (+ 3209us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.225453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.225461 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:37:39.225485 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.225486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.225497 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.225556 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.226651 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.227358 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.228406 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.228685 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.228725 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.230486 (+ 1761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.230487 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.230488 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.230506 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.232191 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.233306 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.233307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.233307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.233369 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.233595 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.233597 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.233597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.233740 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.233817 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.234277 (+ 460us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.234363 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3194,"thread_start_us":73,"threads_started":1}
I20260805 22:37:39.235977 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.222105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37366 (local address 127.19.77.190:40041)
0805 22:37:39.227087 (+ 4982us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.227089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.227098 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:39.227117 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.227118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.227127 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.227201 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.228827 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.230424 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.231409 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.231711 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.231791 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.233133 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.233135 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.233135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.233144 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.234895 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.235305 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.235306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.235306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.235366 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.235504 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.235504 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.235504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.235600 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.235706 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.235799 (+ 93us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.235869 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4962,"thread_start_us":68,"threads_started":1}
I20260805 22:37:39.237520 26051 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37366:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:39.239281 26051 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:39.248807 27337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.244448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33364 (local address 127.19.77.188:43899)
0805 22:37:39.244554 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.244556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.244771 (+ 215us) server_negotiation.cc:407] Connection header received
0805 22:37:39.244896 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.244897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.244923 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.244981 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:39.245175 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.246003 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.247530 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.248282 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.248335 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.248404 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.248664 (+ 260us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.248722 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260805 22:37:39.249089 27351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.244167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:43899 (local address 127.0.0.1:33364)
0805 22:37:39.244717 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.244726 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.244809 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.245024 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.245025 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.245027 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:39.245061 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.245062 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.246104 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.246105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.247422 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.247425 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.248472 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.248473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.248538 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.248543 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.248985 (+ 442us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.249021 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":162,"threads_started":1}
I20260805 22:37:39.249385 27349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.243855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:42385 (local address 127.0.0.1:60884)
0805 22:37:39.244379 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.244392 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.244449 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.245040 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.245042 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.245044 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:39.245122 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.245124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.246393 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.246394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.247536 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.247538 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.248724 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.248725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.248783 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.248787 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.248817 (+ 30us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.248867 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":212,"threads_started":1}
I20260805 22:37:39.249455 26869 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260805 22:37:39.249855 27347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.244121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38306 (local address 127.19.77.129:36955)
0805 22:37:39.244363 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.244369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.244713 (+ 344us) server_negotiation.cc:407] Connection header received
0805 22:37:39.244857 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.244859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.244877 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.244961 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:39.245129 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.246441 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.248170 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.248977 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.249020 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.249120 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.249688 (+ 568us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.249737 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":110,"threads_started":1}
I20260805 22:37:39.250136 27345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.243958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:36955 (local address 127.0.0.1:38306)
0805 22:37:39.244643 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.244654 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.244745 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.244985 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.244986 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.244988 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:39.245048 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.245050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.246848 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.246848 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.248065 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.248068 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.249474 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.249475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.249551 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.249555 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.250003 (+ 448us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.250061 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":527,"threads_started":1}
I20260805 22:37:39.250346 27350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.243891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33791 (local address 127.0.0.1:34192)
0805 22:37:39.244545 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.244556 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.244616 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.245615 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.245616 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.245619 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:39.245695 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.245697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.247616 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.247617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.248722 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.248725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.250112 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.250113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.250198 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.250204 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.250238 (+ 34us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.250282 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":672,"threads_started":1}
I20260805 22:37:39.250550 26898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd5c36938be54affa462f603439e1e76. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:39.250660 26898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: This master's current role is: LEARNER
I20260805 22:37:39.250795 27348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.244108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60884 (local address 127.19.77.130:42385)
0805 22:37:39.244735 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.244739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.244750 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:39.244819 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.244822 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.244838 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.244926 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:39.245192 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.246300 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.247631 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.248635 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.249769 (+ 1134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.250550 (+ 781us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.250589 (+ 39us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.250640 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":166,"threads_started":1}
I20260805 22:37:39.251230 26972 tablet_service.cc:1467] Processing CreateTablet for tablet fd5f5e73906f49798f413b5c869175af (DEFAULT_TABLE table=test-table [id=24f376c8bc034061affc633a31d0dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:39.251529 27114 tablet_service.cc:1467] Processing CreateTablet for tablet fd5f5e73906f49798f413b5c869175af (DEFAULT_TABLE table=test-table [id=24f376c8bc034061affc633a31d0dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:39.251718 26972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd5f5e73906f49798f413b5c869175af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:39.251889 27114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd5f5e73906f49798f413b5c869175af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:39.255725 27346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.243997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34192 (local address 127.19.77.131:33791)
0805 22:37:39.245323 (+ 1326us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.245327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.245338 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:39.245404 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.245406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.245422 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.245802 (+ 380us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:39.245864 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.247513 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.248983 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.249951 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.255324 (+ 5373us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.255490 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.255536 (+ 46us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.255609 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1268,"thread_start_us":100,"threads_started":1}
I20260805 22:37:39.256008 27356 tablet_bootstrap.cc:492] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: Bootstrap starting.
I20260805 22:37:39.256522 27355 tablet_bootstrap.cc:492] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: Bootstrap starting.
I20260805 22:37:39.256515 27255 tablet_service.cc:1467] Processing CreateTablet for tablet fd5f5e73906f49798f413b5c869175af (DEFAULT_TABLE table=test-table [id=24f376c8bc034061affc633a31d0dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:39.256973 27255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd5f5e73906f49798f413b5c869175af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:39.257565 27356 tablet_bootstrap.cc:654] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:39.257715 27355 tablet_bootstrap.cc:654] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:39.258205 27356 log.cc:824] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:39.258276 27355 log.cc:824] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:39.259114 27356 tablet_bootstrap.cc:492] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: No bootstrap required, opened a new log
I20260805 22:37:39.259232 27356 ts_tablet_manager.cc:1397] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:37:39.261425 27359 tablet_bootstrap.cc:492] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: Bootstrap starting.
I20260805 22:37:39.262272 27359 tablet_bootstrap.cc:654] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:39.262395 27356 raft_consensus.cc:348] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } } peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } }
I20260805 22:37:39.262569 27356 raft_consensus.cc:374] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:39.262614 27356 raft_consensus.cc:729] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5de5f09b5c0c473988f85e31b5fd71ac, State: Initialized, Role: FOLLOWER
I20260805 22:37:39.262741 27356 consensus_queue.cc:260] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } } peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } }
I20260805 22:37:39.262930 27359 log.cc:824] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:39.263046 27356 ts_tablet_manager.cc:1428] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260805 22:37:39.263209 27184 heartbeater.cc:503] Master 127.19.77.190:40041 was elected leader, sending a full tablet report...
I20260805 22:37:39.264019 27355 tablet_bootstrap.cc:492] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: No bootstrap required, opened a new log
I20260805 22:37:39.264106 27355 ts_tablet_manager.cc:1397] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260805 22:37:39.267046 27355 raft_consensus.cc:348] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } } peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } }
I20260805 22:37:39.267273 27355 raft_consensus.cc:374] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:39.267338 27355 raft_consensus.cc:729] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a19182e80491476cb34da91f489f1d23, State: Initialized, Role: FOLLOWER
I20260805 22:37:39.267475 27355 consensus_queue.cc:260] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } } peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } }
I20260805 22:37:39.267804 27355 ts_tablet_manager.cc:1428] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260805 22:37:39.267823 27359 tablet_bootstrap.cc:492] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: No bootstrap required, opened a new log
I20260805 22:37:39.267891 27359 ts_tablet_manager.cc:1397] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260805 22:37:39.268077 27043 heartbeater.cc:503] Master 127.19.77.190:40041 was elected leader, sending a full tablet report...
I20260805 22:37:39.270488 27359 raft_consensus.cc:348] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } } peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } }
I20260805 22:37:39.270633 27359 raft_consensus.cc:374] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:39.270658 27359 raft_consensus.cc:729] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa33225a1ad24d3cad72116a37fd7583, State: Initialized, Role: FOLLOWER
I20260805 22:37:39.270783 27359 consensus_queue.cc:260] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } } peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } }
I20260805 22:37:39.271109 27359 ts_tablet_manager.cc:1428] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260805 22:37:39.271281 27324 heartbeater.cc:503] Master 127.19.77.190:40041 was elected leader, sending a full tablet report...
W20260805 22:37:39.301182 27186 tablet.cc:2369] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:37:39.372550 27045 tablet.cc:2369] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:37:39.398976 27360 raft_consensus.cc:482] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:39.399122 27360 raft_consensus.cc:504] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } } peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } }
I20260805 22:37:39.399603 27360 leader_election.cc:288] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa33225a1ad24d3cad72116a37fd7583 (127.19.77.131:33791), a19182e80491476cb34da91f489f1d23 (127.19.77.129:36955)
I20260805 22:37:39.402930 27347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.400002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:38521 (local address 127.19.77.129:36955)
0805 22:37:39.400056 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.400058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.400069 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:39.400099 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.400100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.400110 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.400196 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:39.400382 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.401057 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.402168 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.402541 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.402646 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.402655 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.402813 (+ 158us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.402856 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:37:39.402931 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.399873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:36955 (local address 127.19.77.130:38521)
0805 22:37:39.399960 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.399974 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.400031 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.400212 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.400213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.400215 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:39.400307 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.400309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.401147 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.401148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.402046 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.402049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.402646 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.402647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.402736 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.402739 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.402807 (+ 68us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.402855 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":58}
I20260805 22:37:39.403030 27187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.399856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33791 (local address 127.19.77.130:55829)
0805 22:37:39.399948 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:39.399961 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:39.400023 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:39.400183 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:39.400184 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:39.400186 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:39.400428 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.400431 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.401172 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.401173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.402113 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:39.402115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.402677 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.402678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:39.402809 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.402812 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:39.402902 (+ 90us) client_negotiation.cc:240] Negotiation successful
0805 22:37:39.402943 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260805 22:37:39.403021 27346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.399916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:55829 (local address 127.19.77.131:33791)
0805 22:37:39.399973 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.399975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.400006 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:37:39.400096 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.400103 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.400112 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.400158 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:39.400543 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.401060 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.402209 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.402576 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.402669 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.402678 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.402908 (+ 230us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.402949 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:37:39.403390 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f5e73906f49798f413b5c869175af" candidate_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a19182e80491476cb34da91f489f1d23" is_pre_election: true
I20260805 22:37:39.403573 26996 raft_consensus.cc:2454] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5de5f09b5c0c473988f85e31b5fd71ac in term 0.
I20260805 22:37:39.403839 27068 leader_election.cc:302] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5de5f09b5c0c473988f85e31b5fd71ac, a19182e80491476cb34da91f489f1d23; no voters:
I20260805 22:37:39.403841 27275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f5e73906f49798f413b5c869175af" candidate_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa33225a1ad24d3cad72116a37fd7583" is_pre_election: true
I20260805 22:37:39.403975 27275 raft_consensus.cc:2454] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5de5f09b5c0c473988f85e31b5fd71ac in term 0.
I20260805 22:37:39.404078 27360 raft_consensus.cc:2781] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:39.404160 27360 raft_consensus.cc:482] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:39.404188 27360 raft_consensus.cc:3037] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:39.405022 27360 raft_consensus.cc:504] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } } peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } }
I20260805 22:37:39.405175 27360 leader_election.cc:288] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [CANDIDATE]: Term 1 election: Requested vote from peers aa33225a1ad24d3cad72116a37fd7583 (127.19.77.131:33791), a19182e80491476cb34da91f489f1d23 (127.19.77.129:36955)
I20260805 22:37:39.405332 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f5e73906f49798f413b5c869175af" candidate_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a19182e80491476cb34da91f489f1d23"
I20260805 22:37:39.405352 27275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f5e73906f49798f413b5c869175af" candidate_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa33225a1ad24d3cad72116a37fd7583"
I20260805 22:37:39.405447 26996 raft_consensus.cc:3037] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:39.405441 27275 raft_consensus.cc:3037] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:39.406188 26996 raft_consensus.cc:2454] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5de5f09b5c0c473988f85e31b5fd71ac in term 1.
I20260805 22:37:39.406421 27068 leader_election.cc:302] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5de5f09b5c0c473988f85e31b5fd71ac, a19182e80491476cb34da91f489f1d23; no voters:
I20260805 22:37:39.406514 27360 raft_consensus.cc:2781] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:39.406682 27360 raft_consensus.cc:686] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 1 LEADER]: Becoming Leader. State: Replica: 5de5f09b5c0c473988f85e31b5fd71ac, State: Running, Role: LEADER
I20260805 22:37:39.406737 27275 raft_consensus.cc:2454] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5de5f09b5c0c473988f85e31b5fd71ac in term 1.
I20260805 22:37:39.406759 27360 consensus_queue.cc:237] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } } peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } }
I20260805 22:37:39.407842 26051 catalog_manager.cc:5495] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5de5f09b5c0c473988f85e31b5fd71ac (127.19.77.130). New cstate: current_term: 1 leader_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260805 22:37:39.408604 27341 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: NON_VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: true } } }
I20260805 22:37:39.408712 27341 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:39.409777 27366 raft_consensus.cc:1050] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76: attempting to promote NON_VOTER 7401ed42b45540b6826dc4a5a7fd8027 to VOTER
I20260805 22:37:39.409924 27366 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } }
I20260805 22:37:39.410467 26679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Refusing update from remote peer cd5c36938be54affa462f603439e1e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260805 22:37:39.410627 26869 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 LEARNER]: Refusing update from remote peer cd5c36938be54affa462f603439e1e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260805 22:37:39.410691 27366 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260805 22:37:39.410832 27341 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260805 22:37:39.411573 26823 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 7401ed42b45540b6826dc4a5a7fd8027 (127.19.77.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:39.411952 26869 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 7401ed42b45540b6826dc4a5a7fd8027 (127.19.77.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:39.412652 26823 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:39.412736 26823 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:39.412703 27341 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:39.412796 26823 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:39.412860 26823 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:39.412946 26679 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 7401ed42b45540b6826dc4a5a7fd8027 (127.19.77.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:39.412978 26898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:39.413062 26898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:37:39.412804 27341 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:39.413956 27368 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cd5c36938be54affa462f603439e1e76" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:39.414048 27368 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:37:39.430819 27348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.428193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60886 (local address 127.19.77.130:42385)
0805 22:37:39.428263 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.428265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.428275 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:39.428318 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.428319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.428342 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.428428 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:39.428617 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.429103 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.429892 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.430111 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.430206 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.430450 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:39.430566 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:39.430664 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.430703 (+ 39us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.430730 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:37:39.433137 27275 raft_consensus.cc:1261] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583 [term 1 FOLLOWER]: Refusing update from remote peer 5de5f09b5c0c473988f85e31b5fd71ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:39.433156 26996 raft_consensus.cc:1261] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23 [term 1 FOLLOWER]: Refusing update from remote peer 5de5f09b5c0c473988f85e31b5fd71ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:39.433554 27364 consensus_queue.cc:1035] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:39.433717 27360 consensus_queue.cc:1035] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:39.436656 27370 mvcc.cc:205] Tried to move back new op lower bound from 7315330905834991616 to 7315330905731317760. Current Snapshot: MvccSnapshot[applied={T|T < 7315330905834991616}]
I20260805 22:37:39.437652 27372 mvcc.cc:205] Tried to move back new op lower bound from 7315330905834991616 to 7315330905731317760. Current Snapshot: MvccSnapshot[applied={T|T < 7315330905834991616 or (T in {7315330905834991616})}]
I20260805 22:37:39.440392 26051 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:39.440493 26051 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:39.440472 27371 mvcc.cc:205] Tried to move back new op lower bound from 7315330905834991616 to 7315330905731317760. Current Snapshot: MvccSnapshot[applied={T|T < 7315330905834991616 or (T in {7315330905834991616})}]
I20260805 22:37:39.442054 26051 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd5c36938be54affa462f603439e1e76: Sending DeleteTablet for 3 replicas of tablet fd5f5e73906f49798f413b5c869175af
I20260805 22:37:39.442485 27114 tablet_service.cc:1514] Processing DeleteTablet for tablet fd5f5e73906f49798f413b5c869175af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:39 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:60884
I20260805 22:37:39.442773 27255 tablet_service.cc:1514] Processing DeleteTablet for tablet fd5f5e73906f49798f413b5c869175af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:39 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:34192
I20260805 22:37:39.442873 27380 tablet_replica.cc:330] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: stopping tablet replica
I20260805 22:37:39.442945 26972 tablet_service.cc:1514] Processing DeleteTablet for tablet fd5f5e73906f49798f413b5c869175af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:39 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:38306
I20260805 22:37:39.443051 27380 raft_consensus.cc:2229] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:39.443260 27380 raft_consensus.cc:2258] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:39.443760 27382 tablet_replica.cc:330] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: stopping tablet replica
I20260805 22:37:39.443882 27382 raft_consensus.cc:2229] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:39.443988 27382 raft_consensus.cc:2258] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:39.444003 27380 ts_tablet_manager.cc:1905] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:39.444443 27382 ts_tablet_manager.cc:1905] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:39.445355 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 26018
I20260805 22:37:39.446326 27380 ts_tablet_manager.cc:1918] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:39.446419 27380 log.cc:1196] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/fd5f5e73906f49798f413b5c869175af
I20260805 22:37:39.446797 27380 ts_tablet_manager.cc:1939] T fd5f5e73906f49798f413b5c869175af P 5de5f09b5c0c473988f85e31b5fd71ac: Deleting consensus metadata
I20260805 22:37:39.447911 27382 ts_tablet_manager.cc:1918] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:39.447978 27382 log.cc:1196] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/fd5f5e73906f49798f413b5c869175af
I20260805 22:37:39.448170 27382 ts_tablet_manager.cc:1939] T fd5f5e73906f49798f413b5c869175af P a19182e80491476cb34da91f489f1d23: Deleting consensus metadata
I20260805 22:37:39.456207 27381 tablet_replica.cc:330] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: stopping tablet replica
I20260805 22:37:39.456373 27381 raft_consensus.cc:2229] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:39.456501 27381 raft_consensus.cc:2258] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:39.457041 27337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.443883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33372 (local address 127.19.77.188:43899)
0805 22:37:39.443944 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.443953 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.448324 (+ 4371us) server_negotiation.cc:407] Connection header received
0805 22:37:39.448431 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.448433 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.448446 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.448523 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.449402 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.450186 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.451352 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.451674 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.451723 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.453607 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.453609 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.453609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.453616 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.455475 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.455904 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.455905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.455906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.455985 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.456190 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.456190 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.456191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.456336 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.456410 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.456780 (+ 370us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.456880 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:37:39.457240 27381 ts_tablet_manager.cc:1905] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260805 22:37:39.457427 26930 connection.cc:535] server connection from 127.0.0.1:38306 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260805 22:37:39.457717 27067 connection.cc:535] server connection from 127.0.0.1:60884 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 22:37:39.459645 27381 ts_tablet_manager.cc:1918] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:39.459740 27381 log.cc:1196] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/fd5f5e73906f49798f413b5c869175af
I20260805 22:37:39.460024 27381 ts_tablet_manager.cc:1939] T fd5f5e73906f49798f413b5c869175af P aa33225a1ad24d3cad72116a37fd7583: Deleting consensus metadata
W20260805 22:37:39.460506 27207 connection.cc:441] server connection from 127.0.0.1:34192 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34192 (request call id 1) could send its response
I20260805 22:37:39.468252 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.460152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44324 (local address 127.19.77.189:37543)
0805 22:37:39.460208 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.460209 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.460217 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:37:39.460243 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.460244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.460256 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.460304 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.461141 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.461637 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.463090 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.463414 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.463504 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.465135 (+ 1631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.465137 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.465137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.465145 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.466844 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.467248 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.467250 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.467250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.467315 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.467533 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.467534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.467534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.467674 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.467781 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.467889 (+ 108us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.468120 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:37:39.469156 27337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:39.460371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33374 (local address 127.19.77.188:43899)
0805 22:37:39.460455 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:39.460457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:39.460886 (+ 429us) server_negotiation.cc:407] Connection header received
0805 22:37:39.460919 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:39.460920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:39.460931 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:39.461000 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:39.461980 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.462739 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.463979 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:39.464303 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:39.464382 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:39.465818 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:39.465819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:39.465820 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:39.465828 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:39.467485 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.467863 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.467865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.467865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.468046 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:39.468681 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:39.468682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:39.468682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:39.468818 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:39.468893 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:39.469032 (+ 139us) server_negotiation.cc:299] Negotiation successful
0805 22:37:39.469094 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260805 22:37:40.438373 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.437997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.131:40811)
0805 22:37:40.438160 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.438322 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
W20260805 22:37:40.438732 27324 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:40041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:40.439432 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.439190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.129:54445)
0805 22:37:40.439326 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.439395 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
W20260805 22:37:40.439658 27043 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:40041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:40.439996 27393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.439744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.130:47653)
0805 22:37:40.439860 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.439941 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":52,"threads_started":1}
W20260805 22:37:40.440212 27184 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:40041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:40.942701 27394 raft_consensus.cc:482] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd5c36938be54affa462f603439e1e76)
I20260805 22:37:40.942814 27395 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd5c36938be54affa462f603439e1e76)
I20260805 22:37:40.942886 27394 raft_consensus.cc:504] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } }
I20260805 22:37:40.942924 27395 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } }
I20260805 22:37:40.943243 27394 leader_election.cc:288] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041), 7401ed42b45540b6826dc4a5a7fd8027 (127.19.77.188:43899)
I20260805 22:37:40.943647 27395 leader_election.cc:288] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041), c14facf401df4ba6873cf135799be8cf (127.19.77.189:37543)
I20260805 22:37:40.943840 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.943410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37846)
0805 22:37:40.943620 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.943681 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":57,"threads_started":1}
W20260805 22:37:40.944056 26653 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:40.944123 27401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.943700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37854)
0805 22:37:40.944018 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.944077 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":43,"threads_started":1}
W20260805 22:37:40.944226 26843 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:40.944686 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.944584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37860)
0805 22:37:40.944626 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.944653 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260805 22:37:40.944839 26653 leader_election.cc:334] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041): Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:40.945432 27405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.945177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37874)
0805 22:37:40.945345 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.945383 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":82,"threads_started":1}
W20260805 22:37:40.945628 26843 leader_election.cc:334] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041): Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:40.947749 27397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.943426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:43899 (local address 127.0.0.1:33384)
0805 22:37:40.943872 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.943882 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:40.943931 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:40.944599 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:40.944600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:40.944602 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:40.944642 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:40.944644 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:40.945546 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:40.945547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:40.946712 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:40.946716 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:40.947463 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:40.947464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:40.947539 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:40.947543 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:40.947605 (+ 62us) client_negotiation.cc:240] Negotiation successful
0805 22:37:40.947662 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":47,"threads_started":1}
I20260805 22:37:40.947844 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.943578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44336 (local address 127.19.77.189:37543)
0805 22:37:40.943933 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:40.943936 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:40.943943 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:37:40.943969 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:40.943970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:40.943981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:40.944070 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:40.944278 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:40.945127 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:40.946662 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:40.947414 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:40.947498 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:40.947511 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:40.947736 (+ 225us) server_negotiation.cc:299] Negotiation successful
0805 22:37:40.947782 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":47,"threads_started":1}
I20260805 22:37:40.948004 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.943783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33384 (local address 127.19.77.188:43899)
0805 22:37:40.944435 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:40.944436 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:40.944443 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:37:40.944462 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:40.944463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:40.944472 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:40.944553 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:40.944712 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:40.945450 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:40.946803 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:40.947359 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:40.947461 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:40.947475 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:40.947629 (+ 154us) server_negotiation.cc:299] Negotiation successful
0805 22:37:40.947698 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":42,"threads_started":1}
I20260805 22:37:40.948078 27398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.943427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:37543 (local address 127.0.0.1:44336)
0805 22:37:40.943768 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.943780 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:40.943845 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:40.944124 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:40.944125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:40.944127 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:40.944191 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:40.944193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:40.945251 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:40.945252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:40.946563 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:40.946567 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:40.947530 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:40.947531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:40.947590 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:40.947594 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:40.947645 (+ 51us) client_negotiation.cc:240] Negotiation successful
0805 22:37:40.947692 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":66,"threads_started":1}
I20260805 22:37:40.948434 26869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c14facf401df4ba6873cf135799be8cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7401ed42b45540b6826dc4a5a7fd8027" is_pre_election: true
I20260805 22:37:40.948505 26679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7401ed42b45540b6826dc4a5a7fd8027" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c14facf401df4ba6873cf135799be8cf" is_pre_election: true
I20260805 22:37:40.948588 26869 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c14facf401df4ba6873cf135799be8cf in term 1.
I20260805 22:37:40.948649 26679 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7401ed42b45540b6826dc4a5a7fd8027 in term 1.
I20260805 22:37:40.948778 26656 leader_election.cc:302] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7401ed42b45540b6826dc4a5a7fd8027, c14facf401df4ba6873cf135799be8cf; no voters: cd5c36938be54affa462f603439e1e76
I20260805 22:37:40.948861 26844 leader_election.cc:302] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7401ed42b45540b6826dc4a5a7fd8027, c14facf401df4ba6873cf135799be8cf; no voters: cd5c36938be54affa462f603439e1e76
I20260805 22:37:40.948935 27394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260805 22:37:40.948975 27394 raft_consensus.cc:482] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd5c36938be54affa462f603439e1e76)
I20260805 22:37:40.949002 27394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:37:40.948985 27395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260805 22:37:40.949029 27395 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd5c36938be54affa462f603439e1e76)
I20260805 22:37:40.949056 27395 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:37:40.949771 27395 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } }
I20260805 22:37:40.949924 27395 leader_election.cc:288] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 2 election: Requested vote from peers cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041), c14facf401df4ba6873cf135799be8cf (127.19.77.189:37543)
I20260805 22:37:40.950204 27398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.950031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37884)
0805 22:37:40.950140 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.950174 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260805 22:37:40.950186 26679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7401ed42b45540b6826dc4a5a7fd8027" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c14facf401df4ba6873cf135799be8cf"
I20260805 22:37:40.950201 27394 raft_consensus.cc:504] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } }
I20260805 22:37:40.950424 26679 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7401ed42b45540b6826dc4a5a7fd8027 in current term 2: Already voted for candidate c14facf401df4ba6873cf135799be8cf in this term.
I20260805 22:37:40.950655 27394 leader_election.cc:288] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [CANDIDATE]: Term 2 election: Requested vote from peers cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041), 7401ed42b45540b6826dc4a5a7fd8027 (127.19.77.188:43899)
I20260805 22:37:40.950810 27398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.950684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37890)
0805 22:37:40.950727 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.950752 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260805 22:37:40.950745 26869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c14facf401df4ba6873cf135799be8cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7401ed42b45540b6826dc4a5a7fd8027"
I20260805 22:37:40.950865 26869 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c14facf401df4ba6873cf135799be8cf in current term 2: Already voted for candidate 7401ed42b45540b6826dc4a5a7fd8027 in this term.
W20260805 22:37:40.950897 26843 leader_election.cc:334] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041): Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:40.951195 27397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.950536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37888)
0805 22:37:40.951060 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.951162 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505}
I20260805 22:37:40.951112 26843 leader_election.cc:302] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7401ed42b45540b6826dc4a5a7fd8027; no voters: c14facf401df4ba6873cf135799be8cf, cd5c36938be54affa462f603439e1e76
I20260805 22:37:40.951442 27395 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260805 22:37:40.951568 27397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:40.951422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:37896)
0805 22:37:40.951466 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:40.951547 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260805 22:37:40.951658 26653 leader_election.cc:334] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041): Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:40.951702 26653 leader_election.cc:302] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c14facf401df4ba6873cf135799be8cf; no voters: 7401ed42b45540b6826dc4a5a7fd8027, cd5c36938be54affa462f603439e1e76
I20260805 22:37:40.951792 27394 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260805 22:37:41.439620 27406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:41.439301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.131:59207)
0805 22:37:41.439504 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:41.439566 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":90,"threads_started":1}
I20260805 22:37:41.440577 27407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:41.440171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.129:52095)
0805 22:37:41.440451 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:41.440502 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":164,"threads_started":1}
I20260805 22:37:41.440892 27408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:41.440568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.130:52619)
0805 22:37:41.440782 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:41.440821 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":84,"threads_started":1}
I20260805 22:37:42.440737 27409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.440441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.131:60647)
0805 22:37:42.440613 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.440663 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":113,"threads_started":1}
I20260805 22:37:42.441506 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.441253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.129:40219)
0805 22:37:42.441394 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.441430 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260805 22:37:42.442014 27411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.441525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.130:33037)
0805 22:37:42.441912 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.441967 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":56,"threads_started":1}
I20260805 22:37:42.740782 27412 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:42.740931 27412 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } }
I20260805 22:37:42.741169 27412 leader_election.cc:288] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041), c14facf401df4ba6873cf135799be8cf (127.19.77.189:37543)
I20260805 22:37:42.741546 27413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.741332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:38170)
0805 22:37:42.741458 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.741510 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":58,"threads_started":1}
I20260805 22:37:42.741518 26679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7401ed42b45540b6826dc4a5a7fd8027" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c14facf401df4ba6873cf135799be8cf" is_pre_election: true
I20260805 22:37:42.741619 26679 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7401ed42b45540b6826dc4a5a7fd8027 in term 2.
I20260805 22:37:42.741837 26844 leader_election.cc:302] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7401ed42b45540b6826dc4a5a7fd8027, c14facf401df4ba6873cf135799be8cf; no voters:
I20260805 22:37:42.741966 27412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260805 22:37:42.742018 27412 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:42.742020 27413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.741912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:38184)
0805 22:37:42.741966 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.741994 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260805 22:37:42.742057 27412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 2 FOLLOWER]: Advancing to term 3
W20260805 22:37:42.742183 26843 leader_election.cc:334] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041): Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:42.742904 27412 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } }
I20260805 22:37:42.743081 27412 leader_election.cc:288] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 3 election: Requested vote from peers cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041), c14facf401df4ba6873cf135799be8cf (127.19.77.189:37543)
I20260805 22:37:42.743290 27413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.743192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:38192)
0805 22:37:42.743236 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.743262 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260805 22:37:42.743323 26679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7401ed42b45540b6826dc4a5a7fd8027" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c14facf401df4ba6873cf135799be8cf"
I20260805 22:37:42.743443 26679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 2 FOLLOWER]: Advancing to term 3
I20260805 22:37:42.743607 27413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.743522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:38194)
0805 22:37:42.743550 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.743580 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260805 22:37:42.743696 26843 leader_election.cc:334] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041): Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
I20260805 22:37:42.744441 26679 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7401ed42b45540b6826dc4a5a7fd8027 in term 3.
I20260805 22:37:42.744936 26844 leader_election.cc:302] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7401ed42b45540b6826dc4a5a7fd8027, c14facf401df4ba6873cf135799be8cf; no voters: cd5c36938be54affa462f603439e1e76
I20260805 22:37:42.745098 27412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 3 FOLLOWER]: Leader election won for term 3
I20260805 22:37:42.745290 27412 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [term 3 LEADER]: Becoming Leader. State: Replica: 7401ed42b45540b6826dc4a5a7fd8027, State: Running, Role: LEADER
I20260805 22:37:42.745383 27412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } }
I20260805 22:37:42.745800 27415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7401ed42b45540b6826dc4a5a7fd8027. Latest consensus state: current_term: 3 leader_uuid: "7401ed42b45540b6826dc4a5a7fd8027" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:42.745884 27415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:42.746071 27417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:42.746513 27417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:42.746577 27417 catalog_manager.cc:1259] Loaded cluster ID: c0e18ddd226d444bb71ec60381e37009
I20260805 22:37:42.746634 27417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:42.746829 27417 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:42.746922 27417 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Loaded TSK: 0
I20260805 22:37:42.747073 27417 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:37:42.802562 26859 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:42.804383 26859 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:42.805660 27413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.805508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:38204)
0805 22:37:42.805582 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.805625 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260805 22:37:42.805660 26679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [term 3 FOLLOWER]: Refusing update from remote peer 7401ed42b45540b6826dc4a5a7fd8027: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260805 22:37:42.805900 27412 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260805 22:37:42.806046 27413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.805941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.0.0.1:38206)
0805 22:37:42.805992 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.806024 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260805 22:37:42.806201 26843 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 -> Peer cd5c36938be54affa462f603439e1e76 (127.19.77.190:40041): Couldn't send request to peer cd5c36938be54affa462f603439e1e76. Status: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260805 22:37:42.806651 27419 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7401ed42b45540b6826dc4a5a7fd8027. Latest consensus state: current_term: 3 leader_uuid: "7401ed42b45540b6826dc4a5a7fd8027" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:42.806768 27419 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:37:42.807243 27412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "7401ed42b45540b6826dc4a5a7fd8027" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:42.807336 27412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:42.807339 27419 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "7401ed42b45540b6826dc4a5a7fd8027" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "cd5c36938be54affa462f603439e1e76" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40041 } } peers { permanent_uuid: "c14facf401df4ba6873cf135799be8cf" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 37543 } attrs { promote: false } } peers { permanent_uuid: "7401ed42b45540b6826dc4a5a7fd8027" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 43899 } attrs { promote: false } } }
I20260805 22:37:42.807430 27419 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14facf401df4ba6873cf135799be8cf [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:37:42.807794 27420 mvcc.cc:205] Tried to move back new op lower bound from 7315330919649177600 to 7315330919405879296. Current Snapshot: MvccSnapshot[applied={T|T < 7315330919649177600 or (T in {7315330919649177600})}]
I20260805 22:37:42.813493 27424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.809620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38312 (local address 127.19.77.129:36955)
0805 22:37:42.809745 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:42.809747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:42.809755 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:37:42.809784 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:42.809785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:42.809797 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:42.810058 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:42.810136 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.810897 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.812723 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.813110 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.813194 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:42.813208 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:42.813361 (+ 153us) server_negotiation.cc:299] Negotiation successful
0805 22:37:42.813408 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260805 22:37:42.813493 27413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.809379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:36955 (local address 127.0.0.1:38312)
0805 22:37:42.809435 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.809446 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:42.809500 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:42.809899 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:42.809900 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:42.809902 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:42.809981 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:42.809982 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.810973 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.810974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:42.811989 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:42.811992 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.813205 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.813206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:42.813273 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:42.813277 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:42.813356 (+ 79us) client_negotiation.cc:240] Negotiation successful
0805 22:37:42.813407 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260805 22:37:42.813737 27425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.809570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:42385 (local address 127.0.0.1:60896)
0805 22:37:42.810175 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.810186 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:42.810234 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:42.810452 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:42.810453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:42.810456 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:42.810518 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:42.810521 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.811651 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.811652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:42.812637 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:42.812639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.813459 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.813460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:42.813533 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:42.813537 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:37:42.813586 (+ 49us) client_negotiation.cc:240] Negotiation successful
0805 22:37:42.813632 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"mutex_wait_us":5,"thread_start_us":150,"threads_started":1}
I20260805 22:37:42.813931 27427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.809708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34200 (local address 127.19.77.131:33791)
0805 22:37:42.809984 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:42.809988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:42.810180 (+ 192us) server_negotiation.cc:407] Connection header received
0805 22:37:42.810229 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:42.810231 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:42.810247 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:42.810341 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:42.810532 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.811604 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.812859 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.813465 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.813526 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:42.813537 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:42.813775 (+ 238us) server_negotiation.cc:299] Negotiation successful
0805 22:37:42.813829 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":72,"threads_started":1}
I20260805 22:37:42.814059 27428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.809834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60896 (local address 127.19.77.130:42385)
0805 22:37:42.810093 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:42.810096 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:42.810288 (+ 192us) server_negotiation.cc:407] Connection header received
0805 22:37:42.810324 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:42.810325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:42.810336 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:42.810401 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:42.810599 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.811543 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.812726 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.813339 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.813410 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:42.813421 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:42.813909 (+ 488us) server_negotiation.cc:299] Negotiation successful
0805 22:37:42.813970 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":79,"threads_started":1}
I20260805 22:37:42.813869 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.809570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33791 (local address 127.0.0.1:34200)
0805 22:37:42.809983 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.809995 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:42.810055 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:42.810361 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:42.810362 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:42.810365 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:42.810471 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:42.810474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.811724 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.811725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:42.812750 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:42.812752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.813568 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.813569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:42.813641 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:42.813644 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:42.813691 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:37:42.813726 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":152,"threads_started":1}
I20260805 22:37:42.814265 26972 tablet_service.cc:1467] Processing CreateTablet for tablet 52060848cd4d401eb225a7e4859c74a1 (DEFAULT_TABLE table=test-table [id=1fc765e7427d499f801f0235603f4236]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:42.814440 26972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52060848cd4d401eb225a7e4859c74a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:42.814461 27255 tablet_service.cc:1467] Processing CreateTablet for tablet 52060848cd4d401eb225a7e4859c74a1 (DEFAULT_TABLE table=test-table [id=1fc765e7427d499f801f0235603f4236]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:42.814600 27255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52060848cd4d401eb225a7e4859c74a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:42.815865 27430 tablet_bootstrap.cc:492] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23: Bootstrap starting.
I20260805 22:37:42.815924 27114 tablet_service.cc:1467] Processing CreateTablet for tablet 52060848cd4d401eb225a7e4859c74a1 (DEFAULT_TABLE table=test-table [id=1fc765e7427d499f801f0235603f4236]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:42.816053 27114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52060848cd4d401eb225a7e4859c74a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:42.816228 27430 tablet_bootstrap.cc:654] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:42.816613 27429 tablet_bootstrap.cc:492] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583: Bootstrap starting.
I20260805 22:37:42.816984 27430 tablet_bootstrap.cc:492] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23: No bootstrap required, opened a new log
I20260805 22:37:42.817034 27430 ts_tablet_manager.cc:1397] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:42.817186 27430 raft_consensus.cc:348] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } } peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } }
I20260805 22:37:42.817255 27430 raft_consensus.cc:374] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:42.817272 27430 raft_consensus.cc:729] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a19182e80491476cb34da91f489f1d23, State: Initialized, Role: FOLLOWER
I20260805 22:37:42.817438 27430 consensus_queue.cc:260] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } } peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } }
I20260805 22:37:42.817708 27430 ts_tablet_manager.cc:1428] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:42.817763 27433 tablet_bootstrap.cc:492] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac: Bootstrap starting.
I20260805 22:37:42.818027 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.817923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.129:60141)
0805 22:37:42.817971 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.818000 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260805 22:37:42.818193 27433 tablet_bootstrap.cc:654] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:42.818329 27042 heartbeater.cc:503] Master 127.19.77.188:43899 was elected leader, sending a full tablet report...
I20260805 22:37:42.818346 27429 tablet_bootstrap.cc:654] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:42.818768 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.818666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.129:33897)
0805 22:37:42.818700 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.818734 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260805 22:37:42.819087 27433 tablet_bootstrap.cc:492] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac: No bootstrap required, opened a new log
I20260805 22:37:42.819132 27429 tablet_bootstrap.cc:492] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583: No bootstrap required, opened a new log
I20260805 22:37:42.819183 27433 ts_tablet_manager.cc:1397] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:42.819211 27429 ts_tablet_manager.cc:1397] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260805 22:37:42.819319 27433 raft_consensus.cc:348] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } } peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } }
I20260805 22:37:42.819397 27433 raft_consensus.cc:374] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:42.819368 27429 raft_consensus.cc:348] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } } peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } }
I20260805 22:37:42.819425 27433 raft_consensus.cc:729] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5de5f09b5c0c473988f85e31b5fd71ac, State: Initialized, Role: FOLLOWER
I20260805 22:37:42.819432 27429 raft_consensus.cc:374] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:42.819451 27429 raft_consensus.cc:729] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa33225a1ad24d3cad72116a37fd7583, State: Initialized, Role: FOLLOWER
I20260805 22:37:42.819482 27433 consensus_queue.cc:260] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } } peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } }
I20260805 22:37:42.819537 27429 consensus_queue.cc:260] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } } peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } }
I20260805 22:37:42.819684 27433 ts_tablet_manager.cc:1428] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:42.819981 27411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.819874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.130:36753)
0805 22:37:42.819923 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.819952 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260805 22:37:42.820189 27183 heartbeater.cc:503] Master 127.19.77.188:43899 was elected leader, sending a full tablet report...
I20260805 22:37:42.819756 27429 ts_tablet_manager.cc:1428] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:42.820262 27411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.820181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.130:58543)
0805 22:37:42.820214 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.820237 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260805 22:37:42.820490 27409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.820395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.131:56521)
0805 22:37:42.820440 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.820465 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260805 22:37:42.820678 27323 heartbeater.cc:503] Master 127.19.77.188:43899 was elected leader, sending a full tablet report...
I20260805 22:37:42.820891 27409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.820807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.131:34485)
0805 22:37:42.820840 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.820867 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260805 22:37:42.878139 27437 raft_consensus.cc:482] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:42.878278 27437 raft_consensus.cc:504] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } } peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } }
I20260805 22:37:42.878490 27437 leader_election.cc:288] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa33225a1ad24d3cad72116a37fd7583 (127.19.77.131:33791), a19182e80491476cb34da91f489f1d23 (127.19.77.129:36955)
I20260805 22:37:42.878809 27275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52060848cd4d401eb225a7e4859c74a1" candidate_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa33225a1ad24d3cad72116a37fd7583" is_pre_election: true
I20260805 22:37:42.878929 27275 raft_consensus.cc:2454] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5de5f09b5c0c473988f85e31b5fd71ac in term 0.
I20260805 22:37:42.878942 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52060848cd4d401eb225a7e4859c74a1" candidate_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a19182e80491476cb34da91f489f1d23" is_pre_election: true
I20260805 22:37:42.879055 26996 raft_consensus.cc:2454] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5de5f09b5c0c473988f85e31b5fd71ac in term 0.
I20260805 22:37:42.879158 27067 leader_election.cc:302] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5de5f09b5c0c473988f85e31b5fd71ac, aa33225a1ad24d3cad72116a37fd7583; no voters:
I20260805 22:37:42.879267 27437 raft_consensus.cc:2781] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:42.879303 27437 raft_consensus.cc:482] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:42.879330 27437 raft_consensus.cc:3037] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:42.880160 27437 raft_consensus.cc:504] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } } peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } }
I20260805 22:37:42.880336 27437 leader_election.cc:288] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [CANDIDATE]: Term 1 election: Requested vote from peers aa33225a1ad24d3cad72116a37fd7583 (127.19.77.131:33791), a19182e80491476cb34da91f489f1d23 (127.19.77.129:36955)
I20260805 22:37:42.880527 27275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52060848cd4d401eb225a7e4859c74a1" candidate_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa33225a1ad24d3cad72116a37fd7583"
I20260805 22:37:42.880612 27275 raft_consensus.cc:3037] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:42.880555 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52060848cd4d401eb225a7e4859c74a1" candidate_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a19182e80491476cb34da91f489f1d23"
I20260805 22:37:42.880653 26996 raft_consensus.cc:3037] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:42.881363 27275 raft_consensus.cc:2454] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5de5f09b5c0c473988f85e31b5fd71ac in term 1.
I20260805 22:37:42.881390 26996 raft_consensus.cc:2454] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5de5f09b5c0c473988f85e31b5fd71ac in term 1.
I20260805 22:37:42.881551 27067 leader_election.cc:302] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5de5f09b5c0c473988f85e31b5fd71ac, aa33225a1ad24d3cad72116a37fd7583; no voters:
I20260805 22:37:42.881656 27437 raft_consensus.cc:2781] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:42.881847 27437 raft_consensus.cc:686] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 1 LEADER]: Becoming Leader. State: Replica: 5de5f09b5c0c473988f85e31b5fd71ac, State: Running, Role: LEADER
I20260805 22:37:42.881960 27437 consensus_queue.cc:237] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } } peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } }
I20260805 22:37:42.882236 27411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.882114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.130:44061)
0805 22:37:42.882162 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.882209 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260805 22:37:42.882750 26850 catalog_manager.cc:5495] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5de5f09b5c0c473988f85e31b5fd71ac (127.19.77.130). New cstate: current_term: 1 leader_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5de5f09b5c0c473988f85e31b5fd71ac" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 42385 } health_report { overall_health: HEALTHY } } }
I20260805 22:37:42.907747 27428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.905363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60900 (local address 127.19.77.130:42385)
0805 22:37:42.905433 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:42.905435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:42.905443 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:37:42.905470 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:42.905471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:42.905488 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:42.905551 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:42.905698 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.906200 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.906958 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:42.907213 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:42.907294 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:42.907450 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:42.907495 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:42.907556 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:42.907630 (+ 74us) server_negotiation.cc:299] Negotiation successful
0805 22:37:42.907657 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260805 22:37:42.909135 26996 raft_consensus.cc:1261] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23 [term 1 FOLLOWER]: Refusing update from remote peer 5de5f09b5c0c473988f85e31b5fd71ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:42.909135 27275 raft_consensus.cc:1261] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583 [term 1 FOLLOWER]: Refusing update from remote peer 5de5f09b5c0c473988f85e31b5fd71ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:42.909461 27439 consensus_queue.cc:1035] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "a19182e80491476cb34da91f489f1d23" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:42.909617 27437 consensus_queue.cc:1035] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa33225a1ad24d3cad72116a37fd7583" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:42.910542 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.910410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.129:39027)
0805 22:37:42.910459 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.910502 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260805 22:37:42.910561 27409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.910466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.131:57993)
0805 22:37:42.910509 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.910531 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260805 22:37:42.912443 27409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.912339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.131:44475)
0805 22:37:42.912381 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.912409 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260805 22:37:42.912719 27411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.912599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.130:42945)
0805 22:37:42.912656 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.912685 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260805 22:37:42.912823 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.912720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40041 (local address 127.19.77.129:60705)
0805 22:37:42.912764 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.912791 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:40041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260805 22:37:42.913780 26859 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:42.913897 26859 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:42.915407 26859 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7401ed42b45540b6826dc4a5a7fd8027: Sending DeleteTablet for 3 replicas of tablet 52060848cd4d401eb225a7e4859c74a1
I20260805 22:37:42.915732 26972 tablet_service.cc:1514] Processing DeleteTablet for tablet 52060848cd4d401eb225a7e4859c74a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:42 UTC) from {username='oryx', principal='oryx/127.19.77.188@KRBTEST.COM'} at 127.0.0.1:38312
I20260805 22:37:42.915758 27255 tablet_service.cc:1514] Processing DeleteTablet for tablet 52060848cd4d401eb225a7e4859c74a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:42 UTC) from {username='oryx', principal='oryx/127.19.77.188@KRBTEST.COM'} at 127.0.0.1:34200
I20260805 22:37:42.915771 27114 tablet_service.cc:1514] Processing DeleteTablet for tablet 52060848cd4d401eb225a7e4859c74a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:42 UTC) from {username='oryx', principal='oryx/127.19.77.188@KRBTEST.COM'} at 127.0.0.1:60896
I20260805 22:37:42.916072 27454 tablet_replica.cc:330] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac: stopping tablet replica
I20260805 22:37:42.916131 27452 tablet_replica.cc:330] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23: stopping tablet replica
I20260805 22:37:42.916152 27454 raft_consensus.cc:2229] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:42.916198 27452 raft_consensus.cc:2229] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:42.916217 27454 raft_consensus.cc:2258] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:42.916250 27452 raft_consensus.cc:2258] T 52060848cd4d401eb225a7e4859c74a1 P a19182e80491476cb34da91f489f1d23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:42.916363 27453 tablet_replica.cc:330] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583: stopping tablet replica
I20260805 22:37:42.916425 27453 raft_consensus.cc:2229] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:42.916487 27453 raft_consensus.cc:2258] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:42.916486 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 26820
I20260805 22:37:42.917804 27453 ts_tablet_manager.cc:1905] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:42.919924 27453 ts_tablet_manager.cc:1918] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:42.919986 27453 log.cc:1196] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/52060848cd4d401eb225a7e4859c74a1
I20260805 22:37:42.920226 27453 ts_tablet_manager.cc:1939] T 52060848cd4d401eb225a7e4859c74a1 P aa33225a1ad24d3cad72116a37fd7583: Deleting consensus metadata
I20260805 22:37:42.920644 26843 catalog_manager.cc:4841] TS aa33225a1ad24d3cad72116a37fd7583 (127.19.77.131:33791): tablet 52060848cd4d401eb225a7e4859c74a1 (table test-table [id=1fc765e7427d499f801f0235603f4236]) successfully deleted
I20260805 22:37:42.916563 27454 ts_tablet_manager.cc:1905] T 52060848cd4d401eb225a7e4859c74a1 P 5de5f09b5c0c473988f85e31b5fd71ac: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260805 22:37:42.924299 27426 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:42.924132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:36955 (local address 127.0.0.1:38324)
0805 22:37:42.924196 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.924226 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:36955: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":41}
W20260805 22:37:42.924450 26844 catalog_manager.cc:4584] TS a19182e80491476cb34da91f489f1d23 (127.19.77.129:36955): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 52060848cd4d401eb225a7e4859c74a1: Network error: Client connection negotiation failed: client connection to 127.19.77.129:36955: connect: Connection reset by peer (error 104)
I20260805 22:37:42.924472 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 27051
I20260805 22:37:42.932323 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 27190
I20260805 22:37:42.932435 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:42.932278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:42385 (local address 127.0.0.1:60912)
0805 22:37:42.932334 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:42.932370 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.130:42385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260805 22:37:42.938887 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 26532
I20260805 22:37:42.945442 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 26724
2026-08-05T22:37:42Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6735 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:43 dist-test-slave-chsk krb5kdc[27458](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:43 dist-test-slave-chsk krb5kdc[27458](info): set up 2 sockets
Aug 05 22:37:43 dist-test-slave-chsk krb5kdc[27458](info): commencing operation
krb5kdc: starting...
W20260805 22:37:44.024634 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:44Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.190.keytab.
Entry for principal oryx/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.190.keytab.
I20260805 22:37:44.171023 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:35887
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.190.keytab
--principal=oryx/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:35887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:44.265138 27471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:44.265931 27471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:44.266039 27471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:44.268424 27471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:44.268527 27471 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 22:37:44.268554 27471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:44.268589 27471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:44.268637 27471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:44.268666 27471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:44.271385 27471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:35887
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.190.keytab
--principal=oryx/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:35887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:44.271720 27471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:44.272009 27471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:44.277921 27477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:44.278023 27479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:44.277921 27476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:44.278591 27471 server_base.cc:1034] running on GCE node
I20260805 22:37:44.278954 27471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:44.279431 27471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:44.280694 27471 hybrid_clock.cc:648] HybridClock initialized: now 1785969464280659 us; error 52 us; skew 500 ppm
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:44.284096 27471 init.cc:377] Logged in from keytab as oryx/127.19.77.190@KRBTEST.COM (short username oryx)
I20260805 22:37:44.284709 27471 webserver.cc:460] Webserver started at http://127.19.77.190:34895/ using document root <none> and password file <none>
I20260805 22:37:44.285012 27471 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:44.285075 27471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:44.285224 27471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:44.286912 27471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "64d9379a3f954c1caa3d82096b39ee2d"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "dc60c115337bc23f0d4ab6a91b1e1911"
server_key_iv: "47fd1a5e681ea07739e54dd24f9c2f29"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.287679 27471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "64d9379a3f954c1caa3d82096b39ee2d"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "dc60c115337bc23f0d4ab6a91b1e1911"
server_key_iv: "47fd1a5e681ea07739e54dd24f9c2f29"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.290169 27471 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260805 22:37:44.291494 27486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:44.291805 27471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260805 22:37:44.291935 27471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "64d9379a3f954c1caa3d82096b39ee2d"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "dc60c115337bc23f0d4ab6a91b1e1911"
server_key_iv: "47fd1a5e681ea07739e54dd24f9c2f29"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.292049 27471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:44.306895 27471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:44.310544 27471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:44.310756 27471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:44.316666 27471 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:35887
I20260805 22:37:44.316923 27549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:35887 every 8 connection(s)
I20260805 22:37:44.317276 27471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:44.318179 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 27471
I20260805 22:37:44.318359 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:44.318378 27550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:44.318636 19766 external_mini_cluster.cc:1428] Setting key f64aeb3f1951e81527609c833134333b
I20260805 22:37:44.322613 27550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d: Bootstrap starting.
I20260805 22:37:44.323472 27550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:44.323812 27550 log.cc:824] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:44.324699 27550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d: No bootstrap required, opened a new log
I20260805 22:37:44.327201 27550 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d9379a3f954c1caa3d82096b39ee2d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35887 } }
I20260805 22:37:44.327423 27550 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:44.327462 27550 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d9379a3f954c1caa3d82096b39ee2d, State: Initialized, Role: FOLLOWER
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:44.327610 27550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d9379a3f954c1caa3d82096b39ee2d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35887 } }
I20260805 22:37:44.327737 27550 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:44.327786 27550 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:44.327864 27550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:44.328529 27550 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d9379a3f954c1caa3d82096b39ee2d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35887 } }
I20260805 22:37:44.328629 27550 leader_election.cc:302] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64d9379a3f954c1caa3d82096b39ee2d; no voters:
I20260805 22:37:44.328855 27550 leader_election.cc:288] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:44.329070 27555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:44.329181 27550 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:44.329339 27555 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [term 1 LEADER]: Becoming Leader. State: Replica: 64d9379a3f954c1caa3d82096b39ee2d, State: Running, Role: LEADER
I20260805 22:37:44.329664 27555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d9379a3f954c1caa3d82096b39ee2d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35887 } }
I20260805 22:37:44.331239 27556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64d9379a3f954c1caa3d82096b39ee2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d9379a3f954c1caa3d82096b39ee2d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35887 } } }
I20260805 22:37:44.331552 27556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:44.331188 27557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64d9379a3f954c1caa3d82096b39ee2d. Latest consensus state: current_term: 1 leader_uuid: "64d9379a3f954c1caa3d82096b39ee2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d9379a3f954c1caa3d82096b39ee2d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35887 } } }
I20260805 22:37:44.331804 27570 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:44.331849 27557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:44.332414 27570 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:44.333830 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.319420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56836 (local address 127.19.77.190:35887)
0805 22:37:44.319686 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:44.319697 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:44.319739 (+ 42us) server_negotiation.cc:407] Connection header received
0805 22:37:44.320459 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:44.320467 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:44.320534 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:44.320707 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:44.321724 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.323068 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.324317 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.324798 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.324931 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.328510 (+ 3579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:44.328516 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:44.328516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:44.328538 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:44.331799 (+ 3261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.332318 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.332322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.332323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.332430 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.332684 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.332684 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.332685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.333007 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:44.333180 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:44.333455 (+ 275us) server_negotiation.cc:299] Negotiation successful
0805 22:37:44.333605 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":148,"threads_started":1}
I20260805 22:37:44.335631 27570 catalog_manager.cc:1347] Generated new cluster ID: c2bb590bdc154114b7a66a8d077ec628
I20260805 22:37:44.335693 27570 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:44.342108 27570 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:44.342993 27570 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:44.362234 27570 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d: Generated new TSK 0
I20260805 22:37:44.362512 27570 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab.
Entry for principal oryx/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab.
I20260805 22:37:44.399786 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:35887
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab
--principal=oryx/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:44.492756 27576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:44.493011 27576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:44.493041 27576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:44.495428 27576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:44.495571 27576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:44.495605 27576 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:37:44.495632 27576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:44.498333 27576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab
--principal=oryx/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.77.190:35887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:44.498787 27576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:44.499123 27576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:44.506284 27583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:44.506357 27576 server_base.cc:1034] running on GCE node
W20260805 22:37:44.506284 27581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:44.506283 27585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:44.506888 27576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:44.507336 27576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:44.508549 27576 hybrid_clock.cc:648] HybridClock initialized: now 1785969464508539 us; error 42 us; skew 500 ppm
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:44.511803 27576 init.cc:377] Logged in from keytab as oryx/127.19.77.129@KRBTEST.COM (short username oryx)
I20260805 22:37:44.512570 27576 webserver.cc:460] Webserver started at http://127.19.77.129:44821/ using document root <none> and password file <none>
I20260805 22:37:44.512916 27576 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:44.513002 27576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:44.513185 27576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:44.514588 27576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "198df2c03b5240799f0475ab677cb0fd"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "e72e41d7a033f8ab8253b11c80058ee5"
server_key_iv: "bb7cb988cb0cb1407ea8f1dbf992ed50"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.515049 27576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "198df2c03b5240799f0475ab677cb0fd"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "e72e41d7a033f8ab8253b11c80058ee5"
server_key_iv: "bb7cb988cb0cb1407ea8f1dbf992ed50"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.517228 27576 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260805 22:37:44.518455 27592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:44.518906 27576 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:44.519084 27576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "198df2c03b5240799f0475ab677cb0fd"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "e72e41d7a033f8ab8253b11c80058ee5"
server_key_iv: "bb7cb988cb0cb1407ea8f1dbf992ed50"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.519256 27576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:44.538988 27576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:44.542155 27576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:44.542379 27576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:44.543197 27576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:44.543289 27576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:44.543345 27576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:44.543370 27576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:44.551816 27576 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:42955
I20260805 22:37:44.552224 27576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:44.552417 27708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:42955 every 8 connection(s)
I20260805 22:37:44.556746 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.543934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:53659 (local address 127.19.77.190:35887)
0805 22:37:44.544043 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:44.544048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:44.544440 (+ 392us) server_negotiation.cc:407] Connection header received
0805 22:37:44.545317 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:44.545319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:44.545335 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:44.545423 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:44.546505 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.547069 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.548885 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.549125 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.549207 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.552330 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:44.552331 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:44.552332 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:44.552343 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:44.554146 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.555018 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.555021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.555021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.555110 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.555759 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.555760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.555760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.555915 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:44.556008 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:44.556496 (+ 488us) server_negotiation.cc:299] Negotiation successful
0805 22:37:44.556636 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 22:37:44.556958 27601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.543926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35887 (local address 127.19.77.129:53659)
0805 22:37:44.544182 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:44.544241 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:44.545122 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:44.545520 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:44.545525 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:44.546002 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:44.546366 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.546371 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.547206 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.547207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.548774 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.548778 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.549233 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.549234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.549432 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.550122 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:44.550133 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:44.552197 (+ 2064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:44.554372 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.554392 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.554395 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.554819 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.555445 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.555447 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.555447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.555626 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.556051 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:44.556061 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:44.556273 (+ 212us) client_negotiation.cc:769] Sending connection context
0805 22:37:44.556424 (+ 151us) client_negotiation.cc:240] Negotiation successful
0805 22:37:44.556644 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":132,"threads_started":1}
I20260805 22:37:44.557873 27709 heartbeater.cc:347] Connected to a master server at 127.19.77.190:35887
I20260805 22:37:44.557994 27709 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:44.558276 27709 heartbeater.cc:511] Master 127.19.77.190:35887 requested a full tablet report, sending...
I20260805 22:37:44.558305 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 27576
I20260805 22:37:44.558470 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:44.558734 19766 external_mini_cluster.cc:1428] Setting key cd046bfd8a19d281a8799b36aa2fa4cf
I20260805 22:37:44.559124 27502 ts_manager.cc:194] Registered new tserver with Master: 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955)
I20260805 22:37:44.560127 27502 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:53659
I20260805 22:37:44.567375 27715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.559353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35887 (local address 127.19.77.129:52621)
0805 22:37:44.559589 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:44.559604 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:44.559683 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:44.559877 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:44.559877 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:44.560152 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:44.560239 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.560241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.561080 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.561082 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.561791 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.561793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.562282 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.562284 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.562384 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.563030 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:44.563037 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:44.563789 (+ 752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:44.565698 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.565700 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.565701 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.565992 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.566282 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.566283 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.566283 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.566378 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.566802 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:44.566804 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:44.566887 (+ 83us) client_negotiation.cc:769] Sending connection context
0805 22:37:44.566997 (+ 110us) client_negotiation.cc:240] Negotiation successful
0805 22:37:44.567201 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":76,"threads_started":1}
I20260805 22:37:44.567586 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.559451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:52621 (local address 127.19.77.190:35887)
0805 22:37:44.559519 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:44.559521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:44.559687 (+ 166us) server_negotiation.cc:407] Connection header received
0805 22:37:44.559753 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:44.559754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:44.559766 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:44.559843 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:44.560338 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.560964 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.561950 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.562172 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.562251 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.563931 (+ 1680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:44.563932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:44.563933 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:44.563941 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:44.565571 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.566116 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.566117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.566118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.566180 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.566491 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.566493 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.566494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.566701 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:44.566772 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:44.567318 (+ 546us) server_negotiation.cc:299] Negotiation successful
0805 22:37:44.567422 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
WARNING: no policy specified for oryx/127.19.77.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab.
Entry for principal oryx/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab.
I20260805 22:37:44.596065 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:35887
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab
--principal=oryx/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:44.690730 27718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:44.691035 27718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:44.691084 27718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:44.692662 27718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:44.692782 27718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:44.692826 27718 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:37:44.692866 27718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:44.694859 27718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab
--principal=oryx/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.77.190:35887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:44.695269 27718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:44.695549 27718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:44.701630 27724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:44.701679 27718 server_base.cc:1034] running on GCE node
W20260805 22:37:44.701637 27723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:44.701814 27726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:44.702459 27718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:44.702764 27718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:44.704008 27718 hybrid_clock.cc:648] HybridClock initialized: now 1785969464704002 us; error 47 us; skew 500 ppm
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:44.707716 27718 init.cc:377] Logged in from keytab as oryx/127.19.77.130@KRBTEST.COM (short username oryx)
I20260805 22:37:44.708278 27718 webserver.cc:460] Webserver started at http://127.19.77.130:33583/ using document root <none> and password file <none>
I20260805 22:37:44.708568 27718 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:44.708649 27718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:44.708829 27718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:44.710011 27718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "a129bdfdf7c24771be22688f0d3eec06"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "dc219a86024f56243d5d3b97cd207f88"
server_key_iv: "68463b8c9592783298d7bd1ffc44f3b9"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.710455 27718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "a129bdfdf7c24771be22688f0d3eec06"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "dc219a86024f56243d5d3b97cd207f88"
server_key_iv: "68463b8c9592783298d7bd1ffc44f3b9"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.712201 27718 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260805 22:37:44.713590 27733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:44.713945 27718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:44.714185 27718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "a129bdfdf7c24771be22688f0d3eec06"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "dc219a86024f56243d5d3b97cd207f88"
server_key_iv: "68463b8c9592783298d7bd1ffc44f3b9"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.714432 27718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:44.740983 27718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:44.743815 27718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:44.744037 27718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:44.744726 27718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:44.744782 27718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:44.744820 27718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:44.744841 27718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:44.752925 27718 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:41821
I20260805 22:37:44.753011 27852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:41821 every 8 connection(s)
I20260805 22:37:44.753369 27718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:44.754524 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 27718
I20260805 22:37:44.754686 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:37:44.754896 19766 external_mini_cluster.cc:1428] Setting key f60bb0ac28657c0e177711bde70a55a2
I20260805 22:37:44.755896 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.745262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:49769 (local address 127.19.77.190:35887)
0805 22:37:44.745344 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:44.745347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:44.745562 (+ 215us) server_negotiation.cc:407] Connection header received
0805 22:37:44.746091 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:44.746093 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:44.746108 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:44.746193 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:44.747004 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.747909 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.749042 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.749414 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.749520 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.752456 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:44.752458 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:44.752458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:44.752468 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:44.754213 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.754734 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.754736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.754736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.754803 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.755168 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.755169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.755170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.755311 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:44.755388 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:44.755703 (+ 315us) server_negotiation.cc:299] Negotiation successful
0805 22:37:44.755799 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260805 22:37:44.756121 27742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.745227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35887 (local address 127.19.77.130:49769)
0805 22:37:44.745410 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:44.745455 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:44.745975 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:44.746351 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:44.746355 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:44.746696 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:44.746912 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.746917 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.748047 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.748048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.748930 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.748934 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.749547 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.749548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.749696 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.750395 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:44.750409 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:44.752336 (+ 1927us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:44.754310 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.754320 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.754323 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.754655 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.754874 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.754875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.754875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.755049 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.755391 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:44.755400 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:44.755556 (+ 156us) client_negotiation.cc:769] Sending connection context
0805 22:37:44.755668 (+ 112us) client_negotiation.cc:240] Negotiation successful
0805 22:37:44.755866 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":94,"threads_started":1}
I20260805 22:37:44.756733 27853 heartbeater.cc:347] Connected to a master server at 127.19.77.190:35887
I20260805 22:37:44.756879 27853 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:44.757143 27853 heartbeater.cc:511] Master 127.19.77.190:35887 requested a full tablet report, sending...
I20260805 22:37:44.757613 27503 ts_manager.cc:194] Registered new tserver with Master: a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821)
I20260805 22:37:44.758177 27503 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:49769
I20260805 22:37:44.766541 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.757968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:39643 (local address 127.19.77.190:35887)
0805 22:37:44.758004 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:44.758006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:44.758464 (+ 458us) server_negotiation.cc:407] Connection header received
0805 22:37:44.758570 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:44.758571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:44.758585 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:44.758653 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:44.759057 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.759605 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.760741 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.760986 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.761123 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.762773 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:44.762775 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:44.762775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:44.762783 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:44.764424 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.765252 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.765253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.765254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.765328 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.765683 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.765685 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.765686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.765948 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:44.766035 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:44.766313 (+ 278us) server_negotiation.cc:299] Negotiation successful
0805 22:37:44.766414 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:37:44.766584 27860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.757906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35887 (local address 127.19.77.130:39643)
0805 22:37:44.758376 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:44.758393 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:44.758479 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:44.758661 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:44.758662 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:44.758896 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:44.758969 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.758971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.759722 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.759723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.760614 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.760618 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.761128 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.761129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.761215 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.761897 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:44.761907 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:44.762584 (+ 677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:44.764660 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.764662 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.764663 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.765084 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.765439 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.765442 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.765442 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.765546 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.766069 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:44.766070 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:44.766141 (+ 71us) client_negotiation.cc:769] Sending connection context
0805 22:37:44.766247 (+ 106us) client_negotiation.cc:240] Negotiation successful
0805 22:37:44.766415 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for oryx/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab.
Entry for principal oryx/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab.
I20260805 22:37:44.792860 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:35887
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab
--principal=oryx/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:44.887405 27862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:44.887655 27862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:44.887682 27862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:44.888904 27862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:44.888953 27862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:44.888975 27862 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:37:44.889001 27862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:44.890605 27862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab
--principal=oryx/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.77.190:35887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:44.890843 27862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:44.891093 27862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:44.896901 27867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:44.896901 27870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:44.896978 27862 server_base.cc:1034] running on GCE node
W20260805 22:37:44.896957 27868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:44.897511 27862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:44.897838 27862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:44.899080 27862 hybrid_clock.cc:648] HybridClock initialized: now 1785969464899059 us; error 52 us; skew 500 ppm
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:44.902814 27862 init.cc:377] Logged in from keytab as oryx/127.19.77.131@KRBTEST.COM (short username oryx)
I20260805 22:37:44.903836 27862 webserver.cc:460] Webserver started at http://127.19.77.131:46635/ using document root <none> and password file <none>
I20260805 22:37:44.904171 27862 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:44.904254 27862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:44.904424 27862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:44.905635 27862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "5d4b28b6c9154e1a905b585708ec6db8"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "a76fd5c4a12953d0ef7bab2ef0bb50b7"
server_key_iv: "b1b2a8d307ac9b927d8cae604cce8faa"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.906059 27862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "5d4b28b6c9154e1a905b585708ec6db8"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "a76fd5c4a12953d0ef7bab2ef0bb50b7"
server_key_iv: "b1b2a8d307ac9b927d8cae604cce8faa"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.907768 27862 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260805 22:37:44.908835 27877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:44.909085 27862 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:44.909304 27862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "5d4b28b6c9154e1a905b585708ec6db8"
format_stamp: "Formatted at 2026-08-05 22:37:44 on dist-test-slave-chsk"
server_key: "a76fd5c4a12953d0ef7bab2ef0bb50b7"
server_key_iv: "b1b2a8d307ac9b927d8cae604cce8faa"
server_key_version: "encryptionkey@0"
I20260805 22:37:44.909428 27862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:44.942129 27862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:44.944845 27862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:44.945050 27862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:44.945624 27862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:44.945693 27862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:44.945765 27862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:44.945796 27862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:44.955742 27862 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:38023
I20260805 22:37:44.955850 27994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:38023 every 8 connection(s)
I20260805 22:37:44.956257 27862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:37:44.960426 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.946529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:55227 (local address 127.19.77.190:35887)
0805 22:37:44.946606 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:44.946608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:44.946757 (+ 149us) server_negotiation.cc:407] Connection header received
0805 22:37:44.947822 (+ 1065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:44.947825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:44.947860 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:44.947914 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:44.948925 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.949543 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.950818 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.951076 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.951151 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.955532 (+ 4381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:44.955535 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:44.955535 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:44.955554 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:44.957839 (+ 2285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.958496 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.958497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.958497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.958571 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.959122 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.959124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.959124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.959353 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:44.959706 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:44.960258 (+ 552us) server_negotiation.cc:299] Negotiation successful
0805 22:37:44.960353 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260805 22:37:44.960768 27887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.946270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35887 (local address 127.19.77.131:55227)
0805 22:37:44.946575 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:44.946631 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:44.947626 (+ 995us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:44.948045 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:44.948051 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:44.948498 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:44.948780 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.948785 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.949678 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.949681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.950690 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.950693 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.951323 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.951324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.951535 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.952764 (+ 1229us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:44.952776 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:44.955301 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:44.957967 (+ 2666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.957978 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.957980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.958350 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.958749 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.958750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.958751 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.958937 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.959743 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:44.959755 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:44.959933 (+ 178us) client_negotiation.cc:769] Sending connection context
0805 22:37:44.960199 (+ 266us) client_negotiation.cc:240] Negotiation successful
0805 22:37:44.960469 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":110,"threads_started":1}
I20260805 22:37:44.961659 27995 heartbeater.cc:347] Connected to a master server at 127.19.77.190:35887
I20260805 22:37:44.961719 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 27862
I20260805 22:37:44.961805 27995 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:44.961838 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:44.962038 27995 heartbeater.cc:511] Master 127.19.77.190:35887 requested a full tablet report, sending...
I20260805 22:37:44.962072 19766 external_mini_cluster.cc:1428] Setting key 8d45ffee8b0379fac5518104da917a9d
I20260805 22:37:44.962471 27502 ts_manager.cc:194] Registered new tserver with Master: 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131:38023)
I20260805 22:37:44.963013 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:37:44.963021 27502 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:55227
I20260805 22:37:44.973882 28002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.965481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35887 (local address 127.19.77.131:52657)
0805 22:37:44.965716 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:44.965728 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:44.965838 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:44.965974 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:44.965975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:44.966208 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:44.966282 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.966284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.967030 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.967031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.967812 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:44.967814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.968231 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.968232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:44.968302 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.969011 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:44.969018 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:44.969519 (+ 501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:44.971859 (+ 2340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.971862 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.971863 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.972365 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.972889 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:44.972890 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:44.972891 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:44.973001 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:44.973450 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:44.973451 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:44.973570 (+ 119us) client_negotiation.cc:769] Sending connection context
0805 22:37:44.973675 (+ 105us) client_negotiation.cc:240] Negotiation successful
0805 22:37:44.973797 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":169,"threads_started":1}
I20260805 22:37:44.973945 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.965507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:52657 (local address 127.19.77.190:35887)
0805 22:37:44.965602 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:44.965605 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:44.965818 (+ 213us) server_negotiation.cc:407] Connection header received
0805 22:37:44.965895 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:44.965896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:44.965907 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:44.965968 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:44.966370 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.966913 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.967916 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.968149 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.968232 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.969664 (+ 1432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:44.969665 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:44.969666 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:44.969673 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:44.971577 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.972658 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.972660 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.972660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.972752 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:44.973089 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:44.973090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:44.973090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:44.973283 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:44.973372 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:44.973728 (+ 356us) server_negotiation.cc:299] Negotiation successful
0805 22:37:44.973833 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:44 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:37:44.996630 27553 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:44.984292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56842 (local address 127.19.77.190:35887)
0805 22:37:44.984374 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:44.984377 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:44.984390 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:37:44.984422 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:44.984423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:44.984432 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:44.984493 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:44.985232 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.985767 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.986919 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.987204 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:44.987279 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:44.996539 (+ 9260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56842: BlockingRecv error: recv got EOF from 127.0.0.1:56842 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 05 22:37:45 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:45.007407 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:44.997891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56852 (local address 127.19.77.190:35887)
0805 22:37:44.998006 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:44.998009 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:44.998124 (+ 115us) server_negotiation.cc:407] Connection header received
0805 22:37:44.998237 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:44.998238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:44.998252 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:44.998387 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:44.998996 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:44.999639 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.000647 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.000903 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.000991 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.004183 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:45.004186 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:45.004186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:45.004196 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:45.005911 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:45.006355 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:45.006357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:45.006357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:45.006425 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:45.006647 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:45.006648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:45.006648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:45.006785 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:45.006906 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.007132 (+ 226us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.007291 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 22:37:45.010155 27502 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:45.013125 27502 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:45.022909 28019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.017036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:38023 (local address 127.0.0.1:44448)
0805 22:37:45.017569 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.017634 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.017771 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.018170 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.018174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.018177 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:45.018379 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.018385 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.020068 (+ 1683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.020069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.021541 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.021542 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.022550 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.022551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.022614 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.022619 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.022674 (+ 55us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.022761 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":163,"thread_start_us":119,"threads_started":1}
I20260805 22:37:45.023072 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.017522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49200 (local address 127.19.77.129:42955)
0805 22:37:45.017772 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.017779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.017915 (+ 136us) server_negotiation.cc:407] Connection header received
0805 22:37:45.018381 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.018390 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.018421 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.018523 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:45.018811 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.020132 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.021653 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.022403 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.022494 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.022584 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.022825 (+ 241us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.022931 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":124,"threads_started":1}
I20260805 22:37:45.023183 28023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.017774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56688 (local address 127.19.77.130:41821)
0805 22:37:45.017983 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.017989 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.018518 (+ 529us) server_negotiation.cc:407] Connection header received
0805 22:37:45.018583 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.018586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.018606 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.018705 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:45.018889 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.019846 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.021290 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.022127 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.022230 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.022922 (+ 692us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.022954 (+ 32us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.023011 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":116,"threads_started":1}
I20260805 22:37:45.023411 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.017361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:41821 (local address 127.0.0.1:56688)
0805 22:37:45.018077 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.018090 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.018296 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.018713 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.018714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.018716 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:45.018824 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.018826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.019960 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.019961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.021167 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.021170 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.022641 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.022641 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.022697 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.022700 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.022769 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.022815 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"mutex_wait_us":68,"thread_start_us":114,"threads_started":1}
I20260805 22:37:45.022917 28018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.017036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42955 (local address 127.0.0.1:49200)
0805 22:37:45.017831 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.017843 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.017942 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.018622 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.018623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.018627 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:45.018697 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.018699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.020221 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.020222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.021531 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.021535 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.022497 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.022498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.022599 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.022618 (+ 19us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.022697 (+ 79us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.022764 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":779,"mutex_wait_us":46,"thread_start_us":154,"threads_started":1}
I20260805 22:37:45.023802 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.017270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44448 (local address 127.19.77.131:38023)
0805 22:37:45.017953 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.017957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.017966 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:45.018028 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.018030 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.018051 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.018590 (+ 539us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:45.018666 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.019965 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.021633 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.022449 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.023473 (+ 1024us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.023591 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.023622 (+ 31us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.023688 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":218,"threads_started":1}
I20260805 22:37:45.024529 27642 tablet_service.cc:1467] Processing CreateTablet for tablet 76dde0ce1121487aa0c9ae3da7860a00 (DEFAULT_TABLE table=test-table [id=01587a20acd649168465471ac79b6d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.024538 27784 tablet_service.cc:1467] Processing CreateTablet for tablet 76dde0ce1121487aa0c9ae3da7860a00 (DEFAULT_TABLE table=test-table [id=01587a20acd649168465471ac79b6d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.024536 27928 tablet_service.cc:1467] Processing CreateTablet for tablet 76dde0ce1121487aa0c9ae3da7860a00 (DEFAULT_TABLE table=test-table [id=01587a20acd649168465471ac79b6d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.025020 27642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76dde0ce1121487aa0c9ae3da7860a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.025020 27928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76dde0ce1121487aa0c9ae3da7860a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.025020 27784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76dde0ce1121487aa0c9ae3da7860a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.029511 28024 tablet_bootstrap.cc:492] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: Bootstrap starting.
I20260805 22:37:45.030253 28025 tablet_bootstrap.cc:492] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: Bootstrap starting.
I20260805 22:37:45.030577 28026 tablet_bootstrap.cc:492] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: Bootstrap starting.
I20260805 22:37:45.030812 28024 tablet_bootstrap.cc:654] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.031133 28025 tablet_bootstrap.cc:654] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.031301 28024 log.cc:824] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:45.031445 28026 tablet_bootstrap.cc:654] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.031507 28025 log.cc:824] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:45.031786 28026 log.cc:824] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:45.032222 28024 tablet_bootstrap.cc:492] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: No bootstrap required, opened a new log
I20260805 22:37:45.032320 28024 ts_tablet_manager.cc:1397] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:37:45.032431 28025 tablet_bootstrap.cc:492] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: No bootstrap required, opened a new log
I20260805 22:37:45.032523 28025 ts_tablet_manager.cc:1397] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:37:45.032555 28026 tablet_bootstrap.cc:492] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: No bootstrap required, opened a new log
I20260805 22:37:45.032620 28026 ts_tablet_manager.cc:1397] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:45.034292 28024 raft_consensus.cc:348] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } }
I20260805 22:37:45.034489 28024 raft_consensus.cc:374] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.034543 28024 raft_consensus.cc:729] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198df2c03b5240799f0475ab677cb0fd, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.034685 28024 consensus_queue.cc:260] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } }
I20260805 22:37:45.034698 28025 raft_consensus.cc:348] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } }
I20260805 22:37:45.034698 28026 raft_consensus.cc:348] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } }
I20260805 22:37:45.035024 28024 ts_tablet_manager.cc:1428] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:37:45.035037 27709 heartbeater.cc:503] Master 127.19.77.190:35887 was elected leader, sending a full tablet report...
I20260805 22:37:45.034861 28025 raft_consensus.cc:374] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.034861 28026 raft_consensus.cc:374] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.035254 28026 raft_consensus.cc:729] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a129bdfdf7c24771be22688f0d3eec06, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.035317 28025 raft_consensus.cc:729] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4b28b6c9154e1a905b585708ec6db8, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.035529 28025 consensus_queue.cc:260] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } }
I20260805 22:37:45.035575 28026 consensus_queue.cc:260] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } }
I20260805 22:37:45.036047 28025 ts_tablet_manager.cc:1428] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260805 22:37:45.036047 28026 ts_tablet_manager.cc:1428] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:37:45.036079 27853 heartbeater.cc:503] Master 127.19.77.190:35887 was elected leader, sending a full tablet report...
I20260805 22:37:45.036252 27995 heartbeater.cc:503] Master 127.19.77.190:35887 was elected leader, sending a full tablet report...
W20260805 22:37:45.053443 27710 tablet.cc:2369] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:37:45.207252 27996 tablet.cc:2369] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:37:45.213707 28030 raft_consensus.cc:482] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:45.214006 28030 raft_consensus.cc:504] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } }
I20260805 22:37:45.214543 28030 leader_election.cc:288] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131:38023), a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821)
I20260805 22:37:45.219534 28033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.214836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:38023 (local address 127.19.77.129:52009)
0805 22:37:45.215047 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.215063 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.215175 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.215589 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.215590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.215593 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:45.215682 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.215685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.216727 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.216728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.218231 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.218234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.219130 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.219132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.219237 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.219243 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.219313 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.219392 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":86,"thread_start_us":145,"threads_started":1}
I20260805 22:37:45.219607 28023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.215430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:48757 (local address 127.19.77.130:41821)
0805 22:37:45.215625 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.215627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.215636 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:45.215665 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.215666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.215676 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.215792 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:45.215973 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.216671 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.218368 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.218978 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.219076 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.219113 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.219416 (+ 303us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.219506 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163}
I20260805 22:37:45.219607 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.215058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:52009 (local address 127.19.77.131:38023)
0805 22:37:45.215138 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.215177 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.215241 (+ 64us) server_negotiation.cc:407] Connection header received
0805 22:37:45.215403 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.215406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.215424 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.215540 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:45.215769 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.216594 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.218360 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.218999 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.219076 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.219088 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.219416 (+ 328us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.219501 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260805 22:37:45.219537 28034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.215124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:41821 (local address 127.19.77.129:48757)
0805 22:37:45.215433 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.215496 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.215586 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.215814 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.215814 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.215817 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:45.215885 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.215886 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.216752 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.216752 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.218230 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.218234 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.219131 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.219132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.219235 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.219241 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.219313 (+ 72us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.219383 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":90,"thread_start_us":75,"threads_started":1}
I20260805 22:37:45.220510 27948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76dde0ce1121487aa0c9ae3da7860a00" candidate_uuid: "198df2c03b5240799f0475ab677cb0fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d4b28b6c9154e1a905b585708ec6db8" is_pre_election: true
I20260805 22:37:45.220504 27805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76dde0ce1121487aa0c9ae3da7860a00" candidate_uuid: "198df2c03b5240799f0475ab677cb0fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a129bdfdf7c24771be22688f0d3eec06" is_pre_election: true
I20260805 22:37:45.220741 27805 raft_consensus.cc:2454] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 198df2c03b5240799f0475ab677cb0fd in term 0.
I20260805 22:37:45.220738 27948 raft_consensus.cc:2454] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 198df2c03b5240799f0475ab677cb0fd in term 0.
I20260805 22:37:45.221099 27594 leader_election.cc:302] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198df2c03b5240799f0475ab677cb0fd, a129bdfdf7c24771be22688f0d3eec06; no voters:
I20260805 22:37:45.221282 28030 raft_consensus.cc:2781] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:45.221342 28030 raft_consensus.cc:482] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:45.221369 28030 raft_consensus.cc:3037] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.222470 28030 raft_consensus.cc:504] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } }
I20260805 22:37:45.222688 28030 leader_election.cc:288] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [CANDIDATE]: Term 1 election: Requested vote from peers 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131:38023), a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821)
I20260805 22:37:45.223018 27805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76dde0ce1121487aa0c9ae3da7860a00" candidate_uuid: "198df2c03b5240799f0475ab677cb0fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a129bdfdf7c24771be22688f0d3eec06"
I20260805 22:37:45.223124 27805 raft_consensus.cc:3037] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.224380 27805 raft_consensus.cc:2454] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198df2c03b5240799f0475ab677cb0fd in term 1.
I20260805 22:37:45.224606 27948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76dde0ce1121487aa0c9ae3da7860a00" candidate_uuid: "198df2c03b5240799f0475ab677cb0fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d4b28b6c9154e1a905b585708ec6db8"
I20260805 22:37:45.224736 27948 raft_consensus.cc:3037] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.224725 27594 leader_election.cc:302] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198df2c03b5240799f0475ab677cb0fd, a129bdfdf7c24771be22688f0d3eec06; no voters:
I20260805 22:37:45.224910 28030 raft_consensus.cc:2781] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:45.225127 28030 raft_consensus.cc:686] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 1 LEADER]: Becoming Leader. State: Replica: 198df2c03b5240799f0475ab677cb0fd, State: Running, Role: LEADER
I20260805 22:37:45.225273 28030 consensus_queue.cc:237] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } }
I20260805 22:37:45.225867 27948 raft_consensus.cc:2454] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198df2c03b5240799f0475ab677cb0fd in term 1.
I20260805 22:37:45.226624 27502 catalog_manager.cc:5495] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 198df2c03b5240799f0475ab677cb0fd (127.19.77.129). New cstate: current_term: 1 leader_uuid: "198df2c03b5240799f0475ab677cb0fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } health_report { overall_health: UNKNOWN } } }
I20260805 22:37:45.254794 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.251108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49212 (local address 127.19.77.129:42955)
0805 22:37:45.251254 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.251257 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.251274 (+ 17us) server_negotiation.cc:407] Connection header received
0805 22:37:45.251493 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.251494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.251525 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.251612 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:45.252014 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.252613 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.253583 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.253832 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.253910 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.254297 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:45.254425 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:45.254504 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.254621 (+ 117us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.254657 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
W20260805 22:37:45.254938 27854 tablet.cc:2369] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:37:45.257154 27805 raft_consensus.cc:1261] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Refusing update from remote peer 198df2c03b5240799f0475ab677cb0fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:45.257228 27948 raft_consensus.cc:1261] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Refusing update from remote peer 198df2c03b5240799f0475ab677cb0fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:45.257747 28030 consensus_queue.cc:1035] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:45.258009 28035 consensus_queue.cc:1035] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:45.261009 28038 mvcc.cc:205] Tried to move back new op lower bound from 7315330929689452544 to 7315330929563475968. Current Snapshot: MvccSnapshot[applied={T|T < 7315330929689452544}]
I20260805 22:37:45.261487 28039 mvcc.cc:205] Tried to move back new op lower bound from 7315330929689452544 to 7315330929563475968. Current Snapshot: MvccSnapshot[applied={T|T < 7315330929689452544}]
I20260805 22:37:45.264601 27502 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:45.264750 27502 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:45.265843 27502 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d: Sending DeleteTablet for 3 replicas of tablet 76dde0ce1121487aa0c9ae3da7860a00
I20260805 22:37:45.266304 27642 tablet_service.cc:1514] Processing DeleteTablet for tablet 76dde0ce1121487aa0c9ae3da7860a00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:49200
I20260805 22:37:45.266336 27928 tablet_service.cc:1514] Processing DeleteTablet for tablet 76dde0ce1121487aa0c9ae3da7860a00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:44448
I20260805 22:37:45.266738 27784 tablet_service.cc:1514] Processing DeleteTablet for tablet 76dde0ce1121487aa0c9ae3da7860a00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:56688
I20260805 22:37:45.266716 27502 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260805 22:37:45.266703 28049 tablet_replica.cc:330] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: stopping tablet replica
W20260805 22:37:45.266878 27502 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:45.266990 28049 raft_consensus.cc:2229] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:45.267190 28049 raft_consensus.cc:2258] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.267328 28050 tablet_replica.cc:330] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: stopping tablet replica
I20260805 22:37:45.267393 28048 tablet_replica.cc:330] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: stopping tablet replica
I20260805 22:37:45.267549 28048 raft_consensus.cc:2229] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:45.267918 28049 ts_tablet_manager.cc:1905] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.268052 28048 raft_consensus.cc:2258] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.268893 27784 tablet_service.cc:1467] Processing CreateTablet for tablet 7c5263882747460488be1aa94686e5f9 (DEFAULT_TABLE table=test-table [id=9a293d11331440a9b691d13728f64740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.269044 27784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c5263882747460488be1aa94686e5f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.269088 28048 ts_tablet_manager.cc:1905] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.270586 28049 ts_tablet_manager.cc:1918] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:45.270716 28049 log.cc:1196] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/76dde0ce1121487aa0c9ae3da7860a00
I20260805 22:37:45.270776 28026 tablet_bootstrap.cc:492] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06: Bootstrap starting.
I20260805 22:37:45.271039 28049 ts_tablet_manager.cc:1939] T 76dde0ce1121487aa0c9ae3da7860a00 P 198df2c03b5240799f0475ab677cb0fd: Deleting consensus metadata
I20260805 22:37:45.271209 28048 ts_tablet_manager.cc:1918] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:45.271376 28048 log.cc:1196] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/76dde0ce1121487aa0c9ae3da7860a00
I20260805 22:37:45.271363 27642 tablet_service.cc:1467] Processing CreateTablet for tablet 7c5263882747460488be1aa94686e5f9 (DEFAULT_TABLE table=test-table [id=9a293d11331440a9b691d13728f64740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.271474 28026 tablet_bootstrap.cc:654] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.271482 27642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c5263882747460488be1aa94686e5f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.271787 28048 ts_tablet_manager.cc:1939] T 76dde0ce1121487aa0c9ae3da7860a00 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting consensus metadata
I20260805 22:37:45.272164 28026 tablet_bootstrap.cc:492] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06: No bootstrap required, opened a new log
I20260805 22:37:45.272218 28026 ts_tablet_manager.cc:1397] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:45.272377 28026 raft_consensus.cc:348] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.272451 28026 raft_consensus.cc:374] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.272472 28026 raft_consensus.cc:729] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a129bdfdf7c24771be22688f0d3eec06, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.272516 28026 consensus_queue.cc:260] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.272670 28026 ts_tablet_manager.cc:1428] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:45.272801 28024 tablet_bootstrap.cc:492] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd: Bootstrap starting.
I20260805 22:37:45.273267 28024 tablet_bootstrap.cc:654] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.273716 27488 catalog_manager.cc:4841] TS 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131:38023): tablet 76dde0ce1121487aa0c9ae3da7860a00 (table test-table [id=01587a20acd649168465471ac79b6d72]) successfully deleted
I20260805 22:37:45.273803 27487 catalog_manager.cc:4841] TS 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955): tablet 76dde0ce1121487aa0c9ae3da7860a00 (table test-table [id=01587a20acd649168465471ac79b6d72]) successfully deleted
I20260805 22:37:45.273902 27928 tablet_service.cc:1467] Processing CreateTablet for tablet 7c5263882747460488be1aa94686e5f9 (DEFAULT_TABLE table=test-table [id=9a293d11331440a9b691d13728f64740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.274039 27928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c5263882747460488be1aa94686e5f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.275225 28025 tablet_bootstrap.cc:492] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8: Bootstrap starting.
I20260805 22:37:45.275395 28050 raft_consensus.cc:2229] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:45.275523 28050 raft_consensus.cc:2258] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.275719 28025 tablet_bootstrap.cc:654] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.276038 28024 tablet_bootstrap.cc:492] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd: No bootstrap required, opened a new log
I20260805 22:37:45.276103 28024 ts_tablet_manager.cc:1397] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260805 22:37:45.276115 28050 ts_tablet_manager.cc:1905] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.276274 28024 raft_consensus.cc:348] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.276352 28024 raft_consensus.cc:374] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.276372 28024 raft_consensus.cc:729] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198df2c03b5240799f0475ab677cb0fd, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.276422 28024 consensus_queue.cc:260] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.276521 28024 ts_tablet_manager.cc:1428] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:45.277134 28025 tablet_bootstrap.cc:492] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8: No bootstrap required, opened a new log
I20260805 22:37:45.277190 28025 ts_tablet_manager.cc:1397] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260805 22:37:45.277340 28025 raft_consensus.cc:348] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.277407 28025 raft_consensus.cc:374] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.277429 28025 raft_consensus.cc:729] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4b28b6c9154e1a905b585708ec6db8, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.277472 28025 consensus_queue.cc:260] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.277561 28025 ts_tablet_manager.cc:1428] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:45.279309 28050 ts_tablet_manager.cc:1918] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:45.279444 28050 log.cc:1196] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/76dde0ce1121487aa0c9ae3da7860a00
I20260805 22:37:45.279728 28050 ts_tablet_manager.cc:1939] T 76dde0ce1121487aa0c9ae3da7860a00 P a129bdfdf7c24771be22688f0d3eec06: Deleting consensus metadata
I20260805 22:37:45.280247 27488 catalog_manager.cc:4841] TS a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821): tablet 76dde0ce1121487aa0c9ae3da7860a00 (table test-table [id=01587a20acd649168465471ac79b6d72]) successfully deleted
I20260805 22:37:45.293160 28032 raft_consensus.cc:482] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:45.293378 28032 raft_consensus.cc:504] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.293938 28032 leader_election.cc:288] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955), a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821)
I20260805 22:37:45.298488 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.294264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:43723 (local address 127.19.77.129:42955)
0805 22:37:45.294346 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.294349 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.294539 (+ 190us) server_negotiation.cc:407] Connection header received
0805 22:37:45.294619 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.294620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.294633 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.294703 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:45.294941 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.295669 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.297419 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.298050 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.298132 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.298145 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.298336 (+ 191us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.298388 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260805 22:37:45.298511 28054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.294179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42955 (local address 127.19.77.131:43723)
0805 22:37:45.294440 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.294452 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.294542 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.294740 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.294741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.294742 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:45.294833 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.294834 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.295767 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.295768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.297242 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.297245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.298186 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.298187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.298270 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.298275 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.298329 (+ 54us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.298385 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":37,"thread_start_us":174,"threads_started":1}
I20260805 22:37:45.298635 27887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.294164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:41821 (local address 127.19.77.131:58141)
0805 22:37:45.294290 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.294301 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.294350 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.294686 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.294687 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.294689 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:37:45.294816 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.294818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.295914 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.295915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.297416 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.297423 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.298252 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.298254 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.298376 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.298383 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.298452 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.298531 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":103}
I20260805 22:37:45.298992 28023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.294440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:58141 (local address 127.19.77.130:41821)
0805 22:37:45.294526 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.294529 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.294541 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:37:45.294578 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.294580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.294596 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.294661 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:37:45.294904 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.295787 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.297565 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.298147 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.298236 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.298246 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.298843 (+ 597us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.298924 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260805 22:37:45.299208 27805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c5263882747460488be1aa94686e5f9" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a129bdfdf7c24771be22688f0d3eec06" is_pre_election: true
I20260805 22:37:45.299304 27805 raft_consensus.cc:2454] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 0.
I20260805 22:37:45.299523 27879 leader_election.cc:302] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d4b28b6c9154e1a905b585708ec6db8, a129bdfdf7c24771be22688f0d3eec06; no voters:
I20260805 22:37:45.299513 27662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c5263882747460488be1aa94686e5f9" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198df2c03b5240799f0475ab677cb0fd" is_pre_election: true
I20260805 22:37:45.299682 27662 raft_consensus.cc:2454] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 0.
I20260805 22:37:45.299714 28032 raft_consensus.cc:2781] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:45.299764 28032 raft_consensus.cc:482] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:45.299791 28032 raft_consensus.cc:3037] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.300673 28032 raft_consensus.cc:504] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.300875 28032 leader_election.cc:288] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 election: Requested vote from peers 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955), a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821)
I20260805 22:37:45.301146 27662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c5263882747460488be1aa94686e5f9" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198df2c03b5240799f0475ab677cb0fd"
I20260805 22:37:45.301239 27662 raft_consensus.cc:3037] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.301216 27805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c5263882747460488be1aa94686e5f9" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a129bdfdf7c24771be22688f0d3eec06"
I20260805 22:37:45.301293 27805 raft_consensus.cc:3037] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.301889 27805 raft_consensus.cc:2454] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 1.
I20260805 22:37:45.302078 27879 leader_election.cc:302] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d4b28b6c9154e1a905b585708ec6db8, a129bdfdf7c24771be22688f0d3eec06; no voters:
I20260805 22:37:45.302181 28032 raft_consensus.cc:2781] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:45.302192 27662 raft_consensus.cc:2454] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 1.
I20260805 22:37:45.302371 28032 raft_consensus.cc:686] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 LEADER]: Becoming Leader. State: Replica: 5d4b28b6c9154e1a905b585708ec6db8, State: Running, Role: LEADER
I20260805 22:37:45.302453 28032 consensus_queue.cc:237] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.303268 27503 catalog_manager.cc:5495] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131). New cstate: current_term: 1 leader_uuid: "5d4b28b6c9154e1a905b585708ec6db8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } health_report { overall_health: HEALTHY } } }
Aug 05 22:37:45 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.190@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:45.342773 28062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.331690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35887 (local address 127.0.0.1:56858)
0805 22:37:45.332080 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.332096 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.332211 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.332464 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.332465 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.332952 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:45.333042 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.333045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.334209 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.334211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.335007 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.335010 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.335461 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.335462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.335511 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.336231 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:45.336236 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:45.338244 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:45.340836 (+ 2592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:45.340852 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:45.340855 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:45.341244 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:45.341674 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:45.341676 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:45.341676 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:45.341770 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:45.342240 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:45.342251 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:45.342323 (+ 72us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.342440 (+ 117us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.342609 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":2,"thread_start_us":259,"threads_started":1}
I20260805 22:37:45.342833 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.331670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56858 (local address 127.19.77.190:35887)
0805 22:37:45.331777 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.331780 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.332221 (+ 441us) server_negotiation.cc:407] Connection header received
0805 22:37:45.332279 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.332281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.332301 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.332434 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:45.333272 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.334088 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.335104 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.335374 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.335461 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.338359 (+ 2898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:45.338360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:45.338360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:45.338371 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:45.340674 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:45.341381 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:45.341384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:45.341385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:45.341525 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:45.341889 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:45.341892 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:45.341892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:45.342114 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:45.342211 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.342478 (+ 267us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.342715 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":122,"server-negotiator.queue_time_us":60}
I20260805 22:37:45.346730 27503 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:56858:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 22:37:45.347033 27503 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:45.348634 27784 tablet_service.cc:1467] Processing CreateTablet for tablet 270c573acd864840a5b7463325c3e9bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d2c4c49d85914b25bd4388be7ecf2833]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:37:45.348666 27928 tablet_service.cc:1467] Processing CreateTablet for tablet 270c573acd864840a5b7463325c3e9bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d2c4c49d85914b25bd4388be7ecf2833]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:37:45.348675 27642 tablet_service.cc:1467] Processing CreateTablet for tablet 270c573acd864840a5b7463325c3e9bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d2c4c49d85914b25bd4388be7ecf2833]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:37:45.348824 27928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 270c573acd864840a5b7463325c3e9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.348824 27784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 270c573acd864840a5b7463325c3e9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.348848 27642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 270c573acd864840a5b7463325c3e9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.350577 28025 tablet_bootstrap.cc:492] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: Bootstrap starting.
I20260805 22:37:45.351094 28025 tablet_bootstrap.cc:654] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.351550 28026 tablet_bootstrap.cc:492] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: Bootstrap starting.
I20260805 22:37:45.351982 28026 tablet_bootstrap.cc:654] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.352758 28024 tablet_bootstrap.cc:492] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: Bootstrap starting.
I20260805 22:37:45.353322 28024 tablet_bootstrap.cc:654] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.354277 28024 tablet_bootstrap.cc:492] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: No bootstrap required, opened a new log
I20260805 22:37:45.354368 28024 ts_tablet_manager.cc:1397] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:37:45.354370 28025 tablet_bootstrap.cc:492] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: No bootstrap required, opened a new log
I20260805 22:37:45.354426 28025 ts_tablet_manager.cc:1397] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260805 22:37:45.354557 28024 raft_consensus.cc:348] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.354655 28024 raft_consensus.cc:374] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.354609 28025 raft_consensus.cc:348] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.354686 28024 raft_consensus.cc:729] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198df2c03b5240799f0475ab677cb0fd, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.354688 28025 raft_consensus.cc:374] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.354712 28025 raft_consensus.cc:729] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4b28b6c9154e1a905b585708ec6db8, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.354734 28024 consensus_queue.cc:260] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.354753 28025 consensus_queue.cc:260] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.354832 28024 ts_tablet_manager.cc:1428] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:45.354842 28025 ts_tablet_manager.cc:1428] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:45.354851 28035 tablet_replica.cc:439] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } }
I20260805 22:37:45.354929 28035 tablet_replica.cc:442] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:45.355041 28032 tablet_replica.cc:439] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } }
I20260805 22:37:45.355120 28032 tablet_replica.cc:442] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:45.355252 28026 tablet_bootstrap.cc:492] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: No bootstrap required, opened a new log
I20260805 22:37:45.355307 28026 ts_tablet_manager.cc:1397] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260805 22:37:45.355470 28026 raft_consensus.cc:348] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.355556 28026 raft_consensus.cc:374] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.355588 28026 raft_consensus.cc:729] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a129bdfdf7c24771be22688f0d3eec06, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.355635 28026 consensus_queue.cc:260] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.355723 28026 ts_tablet_manager.cc:1428] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:45.355831 28031 tablet_replica.cc:439] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } }
I20260805 22:37:45.355968 28031 tablet_replica.cc:442] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:45.562556 28035 raft_consensus.cc:482] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:45.562721 28035 raft_consensus.cc:504] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.562899 28035 leader_election.cc:288] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821), 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131:38023)
I20260805 22:37:45.563220 27805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "270c573acd864840a5b7463325c3e9bf" candidate_uuid: "198df2c03b5240799f0475ab677cb0fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a129bdfdf7c24771be22688f0d3eec06" is_pre_election: true
I20260805 22:37:45.563351 27805 raft_consensus.cc:2454] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 198df2c03b5240799f0475ab677cb0fd in term 0.
I20260805 22:37:45.563390 27948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "270c573acd864840a5b7463325c3e9bf" candidate_uuid: "198df2c03b5240799f0475ab677cb0fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d4b28b6c9154e1a905b585708ec6db8" is_pre_election: true
I20260805 22:37:45.563557 27948 raft_consensus.cc:2454] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 198df2c03b5240799f0475ab677cb0fd in term 0.
I20260805 22:37:45.563566 27594 leader_election.cc:302] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198df2c03b5240799f0475ab677cb0fd, a129bdfdf7c24771be22688f0d3eec06; no voters:
I20260805 22:37:45.563685 28035 raft_consensus.cc:2781] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:45.563763 28035 raft_consensus.cc:482] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:45.563918 28035 raft_consensus.cc:3037] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.564811 28035 raft_consensus.cc:504] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.564987 28035 leader_election.cc:288] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [CANDIDATE]: Term 1 election: Requested vote from peers a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821), 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131:38023)
I20260805 22:37:45.565254 27805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "270c573acd864840a5b7463325c3e9bf" candidate_uuid: "198df2c03b5240799f0475ab677cb0fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a129bdfdf7c24771be22688f0d3eec06"
I20260805 22:37:45.565274 27948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "270c573acd864840a5b7463325c3e9bf" candidate_uuid: "198df2c03b5240799f0475ab677cb0fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d4b28b6c9154e1a905b585708ec6db8"
I20260805 22:37:45.565352 27805 raft_consensus.cc:3037] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.565363 27948 raft_consensus.cc:3037] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.566191 27948 raft_consensus.cc:2454] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198df2c03b5240799f0475ab677cb0fd in term 1.
I20260805 22:37:45.566193 27805 raft_consensus.cc:2454] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198df2c03b5240799f0475ab677cb0fd in term 1.
I20260805 22:37:45.566448 27594 leader_election.cc:302] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198df2c03b5240799f0475ab677cb0fd, 5d4b28b6c9154e1a905b585708ec6db8; no voters:
I20260805 22:37:45.566576 28035 raft_consensus.cc:2781] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:45.566651 28035 raft_consensus.cc:686] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [term 1 LEADER]: Becoming Leader. State: Replica: 198df2c03b5240799f0475ab677cb0fd, State: Running, Role: LEADER
I20260805 22:37:45.566702 28035 consensus_queue.cc:237] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.567008 28043 tablet_replica.cc:439] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: TxnStatusTablet state changed. Reason: New leader 198df2c03b5240799f0475ab677cb0fd. Latest consensus state: current_term: 1 leader_uuid: "198df2c03b5240799f0475ab677cb0fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } }
I20260805 22:37:45.567104 28043 tablet_replica.cc:442] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:37:45.567332 28067 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 22:37:45.567440 28067 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 22:37:45.567436 27502 catalog_manager.cc:5495] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 198df2c03b5240799f0475ab677cb0fd (127.19.77.129). New cstate: current_term: 1 leader_uuid: "198df2c03b5240799f0475ab677cb0fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } health_report { overall_health: UNKNOWN } } }
I20260805 22:37:45.586465 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.583923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49226 (local address 127.19.77.129:42955)
0805 22:37:45.584032 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.584034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.584045 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:45.584102 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.584103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.584115 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.584195 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:45.584361 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.584865 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.585697 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.585901 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.585992 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.586183 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:45.586226 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:45.586289 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.586353 (+ 64us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.586376 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 22:37:45.586494 28062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.583848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42955 (local address 127.0.0.1:49226)
0805 22:37:45.583937 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.583952 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.584017 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.584212 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.584213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.584214 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:45.584282 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.584285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.584987 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.584988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.585595 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.585597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.585991 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.585992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.586059 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.586081 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:45.586292 (+ 211us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:45.586303 (+ 11us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.586352 (+ 49us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.586410 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260805 22:37:45.587828 27805 raft_consensus.cc:1261] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Refusing update from remote peer 198df2c03b5240799f0475ab677cb0fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:45.587862 27948 raft_consensus.cc:1261] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Refusing update from remote peer 198df2c03b5240799f0475ab677cb0fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:45.588109 28035 consensus_queue.cc:1035] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:45.588259 28043 consensus_queue.cc:1035] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:45.588829 28031 tablet_replica.cc:439] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: TxnStatusTablet state changed. Reason: New leader 198df2c03b5240799f0475ab677cb0fd. Latest consensus state: current_term: 1 leader_uuid: "198df2c03b5240799f0475ab677cb0fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } }
I20260805 22:37:45.588920 28031 tablet_replica.cc:442] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:45.588910 28032 tablet_replica.cc:439] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: TxnStatusTablet state changed. Reason: New leader 198df2c03b5240799f0475ab677cb0fd. Latest consensus state: current_term: 1 leader_uuid: "198df2c03b5240799f0475ab677cb0fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } }
I20260805 22:37:45.589010 28032 tablet_replica.cc:442] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:45.589811 28035 tablet_replica.cc:439] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "198df2c03b5240799f0475ab677cb0fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } }
I20260805 22:37:45.589908 28035 tablet_replica.cc:442] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:37:45.589993 28040 mvcc.cc:205] Tried to move back new op lower bound from 7315330931045670912 to 7315330930961637376. Current Snapshot: MvccSnapshot[applied={T|T < 7315330931045670912}]
I20260805 22:37:45.590098 28032 tablet_replica.cc:439] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "198df2c03b5240799f0475ab677cb0fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } }
I20260805 22:37:45.590160 28032 tablet_replica.cc:442] T 270c573acd864840a5b7463325c3e9bf P 5d4b28b6c9154e1a905b585708ec6db8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:45.590915 28030 tablet_replica.cc:439] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "198df2c03b5240799f0475ab677cb0fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } }
I20260805 22:37:45.591012 28030 tablet_replica.cc:442] T 270c573acd864840a5b7463325c3e9bf P 198df2c03b5240799f0475ab677cb0fd: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:37:45.591679 28031 tablet_replica.cc:439] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "198df2c03b5240799f0475ab677cb0fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } } }
I20260805 22:37:45.591774 28031 tablet_replica.cc:442] T 270c573acd864840a5b7463325c3e9bf P a129bdfdf7c24771be22688f0d3eec06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:37:45.594791 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.592098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44450 (local address 127.19.77.131:38023)
0805 22:37:45.592142 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.592144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.592157 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:37:45.592272 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.592274 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.592301 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.592378 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:45.592511 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.593133 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.593911 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.594127 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.594211 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.594359 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:45.594483 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:45.594566 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.594656 (+ 90us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.594680 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:37:45.600359 28074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.597537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42955 (local address 127.19.77.131:55433)
0805 22:37:45.597718 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.597737 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.597812 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.597955 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.597956 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.597958 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:45.598057 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.598058 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.598713 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.598714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.599494 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.599497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.599886 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.599887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.599956 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.599978 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:45.600176 (+ 198us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:45.600179 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.600222 (+ 43us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.600266 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":98,"threads_started":1}
I20260805 22:37:45.600343 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.597599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:55433 (local address 127.19.77.129:42955)
0805 22:37:45.597652 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.597654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.597796 (+ 142us) server_negotiation.cc:407] Connection header received
0805 22:37:45.597867 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.597868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.597879 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.597968 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:45.598147 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.598625 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.599611 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.599808 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.599890 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.600072 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:45.600113 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:45.600174 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.600234 (+ 60us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.600258 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:37:45.603178 27805 raft_consensus.cc:1261] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Refusing update from remote peer 5d4b28b6c9154e1a905b585708ec6db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:45.603287 27662 raft_consensus.cc:1261] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Refusing update from remote peer 5d4b28b6c9154e1a905b585708ec6db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:45.603664 28055 consensus_queue.cc:1035] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:45.603812 28032 consensus_queue.cc:1035] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:45.613399 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.610504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:38023 (local address 127.19.77.129:41299)
0805 22:37:45.610686 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:45.610697 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:45.610774 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:45.610898 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:45.610899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:45.610900 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:37:45.610960 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.610962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.611694 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.611695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.612545 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:45.612548 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.612916 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.612917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:45.612971 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.612998 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:37:45.613226 (+ 228us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:37:45.613228 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:37:45.613271 (+ 43us) client_negotiation.cc:240] Negotiation successful
0805 22:37:45.613320 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260805 22:37:45.613382 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.610554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:41299 (local address 127.19.77.131:38023)
0805 22:37:45.610597 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.610599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.610758 (+ 159us) server_negotiation.cc:407] Connection header received
0805 22:37:45.610826 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.610827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.610838 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.610895 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:45.611037 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.611602 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.612628 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.612837 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.612915 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.613096 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:45.613138 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:45.613209 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.613273 (+ 64us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.613294 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:37:45.623668 27502 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:45.623813 27502 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:45.624650 27502 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d: Sending DeleteTablet for 3 replicas of tablet 7c5263882747460488be1aa94686e5f9
I20260805 22:37:45.624950 27642 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c5263882747460488be1aa94686e5f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:49200
I20260805 22:37:45.625010 27928 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c5263882747460488be1aa94686e5f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:44448
I20260805 22:37:45.625070 28049 tablet_replica.cc:330] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd: stopping tablet replica
I20260805 22:37:45.625097 28048 tablet_replica.cc:330] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8: stopping tablet replica
I20260805 22:37:45.625123 28049 raft_consensus.cc:2229] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:45.625136 28048 raft_consensus.cc:2229] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:45.625167 28049 raft_consensus.cc:2258] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.625233 28048 raft_consensus.cc:2258] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.625550 28049 ts_tablet_manager.cc:1905] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.625630 28048 ts_tablet_manager.cc:1905] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.627015 27784 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c5263882747460488be1aa94686e5f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:56688
I20260805 22:37:45.627175 28050 tablet_replica.cc:330] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06: stopping tablet replica
I20260805 22:37:45.627234 28050 raft_consensus.cc:2229] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:45.627282 28050 raft_consensus.cc:2258] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.627307 28048 ts_tablet_manager.cc:1918] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:45.627393 28048 log.cc:1196] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/7c5263882747460488be1aa94686e5f9
I20260805 22:37:45.627635 28048 ts_tablet_manager.cc:1939] T 7c5263882747460488be1aa94686e5f9 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting consensus metadata
I20260805 22:37:45.628113 27488 catalog_manager.cc:4841] TS 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131:38023): tablet 7c5263882747460488be1aa94686e5f9 (table test-table [id=9a293d11331440a9b691d13728f64740]) successfully deleted
I20260805 22:37:45.628376 28050 ts_tablet_manager.cc:1905] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.630025 28050 ts_tablet_manager.cc:1918] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:45.630086 28050 log.cc:1196] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/7c5263882747460488be1aa94686e5f9
I20260805 22:37:45.630308 28050 ts_tablet_manager.cc:1939] T 7c5263882747460488be1aa94686e5f9 P a129bdfdf7c24771be22688f0d3eec06: Deleting consensus metadata
I20260805 22:37:45.630795 28049 ts_tablet_manager.cc:1918] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:45.630860 28049 log.cc:1196] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/7c5263882747460488be1aa94686e5f9
I20260805 22:37:45.631091 28049 ts_tablet_manager.cc:1939] T 7c5263882747460488be1aa94686e5f9 P 198df2c03b5240799f0475ab677cb0fd: Deleting consensus metadata
I20260805 22:37:45.631538 27487 catalog_manager.cc:4841] TS 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955): tablet 7c5263882747460488be1aa94686e5f9 (table test-table [id=9a293d11331440a9b691d13728f64740]) successfully deleted
I20260805 22:37:45.631691 27488 catalog_manager.cc:4841] TS a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821): tablet 7c5263882747460488be1aa94686e5f9 (table test-table [id=9a293d11331440a9b691d13728f64740]) successfully deleted
Aug 05 22:37:45 dist-test-slave-chsk krb5kdc[27458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:37:45 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:45 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:37:45.652384 27553 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:45.646687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56872 (local address 127.19.77.190:35887)
0805 22:37:45.646739 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.646741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.646904 (+ 163us) server_negotiation.cc:407] Connection header received
0805 22:37:45.647008 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.647009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.647019 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.647080 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:45.647759 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.648275 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.649030 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.649227 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.649317 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.652331 (+ 3014us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56872: BlockingRecv error: recv got EOF from 127.0.0.1:56872 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 05 22:37:45 dist-test-slave-chsk krb5kdc[27458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM
I20260805 22:37:45.661636 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.653511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56880 (local address 127.19.77.190:35887)
0805 22:37:45.653752 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.653754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.653948 (+ 194us) server_negotiation.cc:407] Connection header received
0805 22:37:45.654040 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.654041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.654058 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.654124 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:45.654609 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.655106 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.655882 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.656082 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.656162 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.658861 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:45.658863 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:45.658863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:45.658872 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:45.660397 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:45.660805 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:45.660806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:45.660806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:45.660869 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:45.661090 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:45.661091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:45.661091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:45.661219 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:45.661383 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.661428 (+ 45us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.661525 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221}
I20260805 22:37:45.663643 27502 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56880:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:37:45.663849 27502 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:45.665310 27784 tablet_service.cc:1467] Processing CreateTablet for tablet b909212c80c74b09975329d406ca6a45 (DEFAULT_TABLE table=test-table [id=ee6fe9ce85734d6e9ab706be4bda265c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.665349 27642 tablet_service.cc:1467] Processing CreateTablet for tablet b909212c80c74b09975329d406ca6a45 (DEFAULT_TABLE table=test-table [id=ee6fe9ce85734d6e9ab706be4bda265c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.665468 27642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b909212c80c74b09975329d406ca6a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.665481 27784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b909212c80c74b09975329d406ca6a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.666901 28026 tablet_bootstrap.cc:492] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06: Bootstrap starting.
I20260805 22:37:45.666926 27928 tablet_service.cc:1467] Processing CreateTablet for tablet b909212c80c74b09975329d406ca6a45 (DEFAULT_TABLE table=test-table [id=ee6fe9ce85734d6e9ab706be4bda265c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.667062 27928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b909212c80c74b09975329d406ca6a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.667384 28026 tablet_bootstrap.cc:654] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.668498 28025 tablet_bootstrap.cc:492] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8: Bootstrap starting.
I20260805 22:37:45.668533 28024 tablet_bootstrap.cc:492] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd: Bootstrap starting.
I20260805 22:37:45.668876 28024 tablet_bootstrap.cc:654] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.668903 28025 tablet_bootstrap.cc:654] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.669723 28025 tablet_bootstrap.cc:492] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8: No bootstrap required, opened a new log
I20260805 22:37:45.669771 28025 ts_tablet_manager.cc:1397] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:45.669943 28025 raft_consensus.cc:348] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.670161 28025 raft_consensus.cc:374] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.670190 28025 raft_consensus.cc:729] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4b28b6c9154e1a905b585708ec6db8, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.670231 28025 consensus_queue.cc:260] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.670329 28025 ts_tablet_manager.cc:1428] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260805 22:37:45.671670 28024 tablet_bootstrap.cc:492] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd: No bootstrap required, opened a new log
I20260805 22:37:45.671741 28024 ts_tablet_manager.cc:1397] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260805 22:37:45.671904 28024 raft_consensus.cc:348] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.672011 28024 raft_consensus.cc:374] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.672039 28024 raft_consensus.cc:729] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198df2c03b5240799f0475ab677cb0fd, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.672084 28024 consensus_queue.cc:260] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.672180 28024 ts_tablet_manager.cc:1428] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:45.672413 28026 tablet_bootstrap.cc:492] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06: No bootstrap required, opened a new log
I20260805 22:37:45.672502 28026 ts_tablet_manager.cc:1397] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260805 22:37:45.672667 28026 raft_consensus.cc:348] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.672767 28026 raft_consensus.cc:374] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.672791 28026 raft_consensus.cc:729] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a129bdfdf7c24771be22688f0d3eec06, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.672842 28026 consensus_queue.cc:260] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.672935 28026 ts_tablet_manager.cc:1428] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:45.743158 28077 raft_consensus.cc:482] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:45.743295 28077 raft_consensus.cc:504] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.743471 28077 leader_election.cc:288] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955), a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821)
I20260805 22:37:45.743673 27805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b909212c80c74b09975329d406ca6a45" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a129bdfdf7c24771be22688f0d3eec06" is_pre_election: true
I20260805 22:37:45.743702 27662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b909212c80c74b09975329d406ca6a45" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198df2c03b5240799f0475ab677cb0fd" is_pre_election: true
I20260805 22:37:45.743763 27805 raft_consensus.cc:2454] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 0.
I20260805 22:37:45.743781 27662 raft_consensus.cc:2454] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 0.
I20260805 22:37:45.743933 27878 leader_election.cc:302] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 198df2c03b5240799f0475ab677cb0fd, 5d4b28b6c9154e1a905b585708ec6db8, a129bdfdf7c24771be22688f0d3eec06; no voters:
I20260805 22:37:45.744035 28077 raft_consensus.cc:2781] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:45.744063 28077 raft_consensus.cc:482] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:45.744083 28077 raft_consensus.cc:3037] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.744861 28077 raft_consensus.cc:504] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.745011 28077 leader_election.cc:288] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 election: Requested vote from peers 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955), a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821)
I20260805 22:37:45.745199 27662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b909212c80c74b09975329d406ca6a45" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198df2c03b5240799f0475ab677cb0fd"
I20260805 22:37:45.745217 27805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b909212c80c74b09975329d406ca6a45" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a129bdfdf7c24771be22688f0d3eec06"
I20260805 22:37:45.745273 27662 raft_consensus.cc:3037] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.745280 27805 raft_consensus.cc:3037] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.746030 27662 raft_consensus.cc:2454] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 1.
I20260805 22:37:45.746030 27805 raft_consensus.cc:2454] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 1.
I20260805 22:37:45.746212 27879 leader_election.cc:302] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d4b28b6c9154e1a905b585708ec6db8, a129bdfdf7c24771be22688f0d3eec06; no voters:
I20260805 22:37:45.746309 28077 raft_consensus.cc:2781] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:45.746354 28077 raft_consensus.cc:686] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 LEADER]: Becoming Leader. State: Replica: 5d4b28b6c9154e1a905b585708ec6db8, State: Running, Role: LEADER
I20260805 22:37:45.746405 28077 consensus_queue.cc:237] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.747201 27502 catalog_manager.cc:5495] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131). New cstate: current_term: 1 leader_uuid: "5d4b28b6c9154e1a905b585708ec6db8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } health_report { overall_health: HEALTHY } } }
I20260805 22:37:45.766769 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:45.763523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44466 (local address 127.19.77.131:38023)
0805 22:37:45.763606 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:45.763609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:45.763621 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:37:45.763650 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:45.763651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:45.763664 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:45.763735 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:37:45.763929 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.764688 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.766004 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:45.766211 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:45.766264 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:45.766503 (+ 239us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:37:45.766531 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:37:45.766567 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:45.766659 (+ 92us) server_negotiation.cc:299] Negotiation successful
0805 22:37:45.766676 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260805 22:37:45.767813 27805 raft_consensus.cc:1261] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Refusing update from remote peer 5d4b28b6c9154e1a905b585708ec6db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:45.767944 27662 raft_consensus.cc:1261] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Refusing update from remote peer 5d4b28b6c9154e1a905b585708ec6db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:45.768095 28077 consensus_queue.cc:1035] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:45.768218 28055 consensus_queue.cc:1035] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:45.770735 27503 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:45.770834 27503 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:45.771595 27503 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d: Sending DeleteTablet for 3 replicas of tablet b909212c80c74b09975329d406ca6a45
I20260805 22:37:45.771881 27784 tablet_service.cc:1514] Processing DeleteTablet for tablet b909212c80c74b09975329d406ca6a45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:56688
I20260805 22:37:45.771989 27928 tablet_service.cc:1514] Processing DeleteTablet for tablet b909212c80c74b09975329d406ca6a45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:44448
I20260805 22:37:45.772156 28050 tablet_replica.cc:330] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06: stopping tablet replica
I20260805 22:37:45.772213 28050 raft_consensus.cc:2229] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:45.772264 28050 raft_consensus.cc:2258] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.772337 28048 tablet_replica.cc:330] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8: stopping tablet replica
I20260805 22:37:45.772400 28048 raft_consensus.cc:2229] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:45.772379 27502 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56880:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260805 22:37:45.772467 28048 raft_consensus.cc:2258] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260805 22:37:45.772526 27502 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:37:45.772567 27642 tablet_service.cc:1514] Processing DeleteTablet for tablet b909212c80c74b09975329d406ca6a45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:49200
I20260805 22:37:45.772753 28049 tablet_replica.cc:330] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd: stopping tablet replica
I20260805 22:37:45.772817 28049 raft_consensus.cc:2229] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:45.772867 28049 raft_consensus.cc:2258] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.772892 28050 ts_tablet_manager.cc:1905] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.773218 28048 ts_tablet_manager.cc:1905] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.774760 28048 ts_tablet_manager.cc:1918] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:45.774817 28048 log.cc:1196] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/b909212c80c74b09975329d406ca6a45
I20260805 22:37:45.775044 28048 ts_tablet_manager.cc:1939] T b909212c80c74b09975329d406ca6a45 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting consensus metadata
I20260805 22:37:45.775585 27488 catalog_manager.cc:4841] TS 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131:38023): tablet b909212c80c74b09975329d406ca6a45 (table test-table [id=ee6fe9ce85734d6e9ab706be4bda265c]) successfully deleted
I20260805 22:37:45.775625 28049 ts_tablet_manager.cc:1905] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.775868 27784 tablet_service.cc:1467] Processing CreateTablet for tablet e4567b5ec3c04fd192421a652952e802 (DEFAULT_TABLE table=test-table [id=86d86dbb24504b9eaa9087b9e923e97e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.775974 28050 ts_tablet_manager.cc:1918] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:45.775990 27784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4567b5ec3c04fd192421a652952e802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.776016 28050 log.cc:1196] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/b909212c80c74b09975329d406ca6a45
I20260805 22:37:45.776247 28050 ts_tablet_manager.cc:1939] T b909212c80c74b09975329d406ca6a45 P a129bdfdf7c24771be22688f0d3eec06: Deleting consensus metadata
I20260805 22:37:45.777143 28026 tablet_bootstrap.cc:492] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06: Bootstrap starting.
I20260805 22:37:45.777289 27642 tablet_service.cc:1467] Processing CreateTablet for tablet e4567b5ec3c04fd192421a652952e802 (DEFAULT_TABLE table=test-table [id=86d86dbb24504b9eaa9087b9e923e97e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.777429 27642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4567b5ec3c04fd192421a652952e802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.777561 28026 tablet_bootstrap.cc:654] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.777891 28049 ts_tablet_manager.cc:1918] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:37:45.778002 28049 log.cc:1196] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/b909212c80c74b09975329d406ca6a45
I20260805 22:37:45.778260 28049 ts_tablet_manager.cc:1939] T b909212c80c74b09975329d406ca6a45 P 198df2c03b5240799f0475ab677cb0fd: Deleting consensus metadata
I20260805 22:37:45.778810 27487 catalog_manager.cc:4841] TS 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955): tablet b909212c80c74b09975329d406ca6a45 (table test-table [id=ee6fe9ce85734d6e9ab706be4bda265c]) successfully deleted
I20260805 22:37:45.779043 28024 tablet_bootstrap.cc:492] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd: Bootstrap starting.
I20260805 22:37:45.779266 27488 catalog_manager.cc:4841] TS a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821): tablet b909212c80c74b09975329d406ca6a45 (table test-table [id=ee6fe9ce85734d6e9ab706be4bda265c]) successfully deleted
I20260805 22:37:45.779414 28024 tablet_bootstrap.cc:654] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.779569 27928 tablet_service.cc:1467] Processing CreateTablet for tablet e4567b5ec3c04fd192421a652952e802 (DEFAULT_TABLE table=test-table [id=86d86dbb24504b9eaa9087b9e923e97e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:37:45.779696 27928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4567b5ec3c04fd192421a652952e802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:45.780121 28024 tablet_bootstrap.cc:492] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd: No bootstrap required, opened a new log
I20260805 22:37:45.780189 28024 ts_tablet_manager.cc:1397] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:45.780303 28024 raft_consensus.cc:348] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.780392 28024 raft_consensus.cc:374] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.780421 28024 raft_consensus.cc:729] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198df2c03b5240799f0475ab677cb0fd, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.780481 28024 consensus_queue.cc:260] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.780611 28024 ts_tablet_manager.cc:1428] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260805 22:37:45.781116 28025 tablet_bootstrap.cc:492] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8: Bootstrap starting.
I20260805 22:37:45.781553 28025 tablet_bootstrap.cc:654] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:45.782249 28025 tablet_bootstrap.cc:492] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8: No bootstrap required, opened a new log
I20260805 22:37:45.782295 28025 ts_tablet_manager.cc:1397] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:45.782413 28025 raft_consensus.cc:348] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.782471 28025 raft_consensus.cc:374] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.782485 28025 raft_consensus.cc:729] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4b28b6c9154e1a905b585708ec6db8, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.782557 28025 consensus_queue.cc:260] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.782680 28025 ts_tablet_manager.cc:1428] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:45.783066 28026 tablet_bootstrap.cc:492] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06: No bootstrap required, opened a new log
I20260805 22:37:45.783133 28026 ts_tablet_manager.cc:1397] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260805 22:37:45.783355 28026 raft_consensus.cc:348] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.783442 28026 raft_consensus.cc:374] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:45.783463 28026 raft_consensus.cc:729] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a129bdfdf7c24771be22688f0d3eec06, State: Initialized, Role: FOLLOWER
I20260805 22:37:45.783506 28026 consensus_queue.cc:260] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.783596 28026 ts_tablet_manager.cc:1428] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:45.950562 28055 raft_consensus.cc:482] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:37:45.950704 28055 raft_consensus.cc:504] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.951072 28055 leader_election.cc:288] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955), a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821)
I20260805 22:37:45.951553 27662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4567b5ec3c04fd192421a652952e802" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198df2c03b5240799f0475ab677cb0fd" is_pre_election: true
I20260805 22:37:45.951865 27662 raft_consensus.cc:2454] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 0.
I20260805 22:37:45.951900 27805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4567b5ec3c04fd192421a652952e802" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a129bdfdf7c24771be22688f0d3eec06" is_pre_election: true
I20260805 22:37:45.952054 27805 raft_consensus.cc:2454] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 0.
I20260805 22:37:45.952126 27878 leader_election.cc:302] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198df2c03b5240799f0475ab677cb0fd, 5d4b28b6c9154e1a905b585708ec6db8; no voters:
I20260805 22:37:45.952320 28055 raft_consensus.cc:2781] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:37:45.952394 28055 raft_consensus.cc:482] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:37:45.952416 28055 raft_consensus.cc:3037] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.953687 28055 raft_consensus.cc:504] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.953860 28055 leader_election.cc:288] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 election: Requested vote from peers 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955), a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821)
I20260805 22:37:45.954071 27805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4567b5ec3c04fd192421a652952e802" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a129bdfdf7c24771be22688f0d3eec06"
I20260805 22:37:45.954181 27805 raft_consensus.cc:3037] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.954162 27662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4567b5ec3c04fd192421a652952e802" candidate_uuid: "5d4b28b6c9154e1a905b585708ec6db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198df2c03b5240799f0475ab677cb0fd"
I20260805 22:37:45.954304 27662 raft_consensus.cc:3037] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:45.954885 27805 raft_consensus.cc:2454] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 1.
I20260805 22:37:45.955130 27879 leader_election.cc:302] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d4b28b6c9154e1a905b585708ec6db8, a129bdfdf7c24771be22688f0d3eec06; no voters:
I20260805 22:37:45.955283 28055 raft_consensus.cc:2781] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:45.955405 28055 raft_consensus.cc:686] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 LEADER]: Becoming Leader. State: Replica: 5d4b28b6c9154e1a905b585708ec6db8, State: Running, Role: LEADER
I20260805 22:37:45.955545 27662 raft_consensus.cc:2454] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4b28b6c9154e1a905b585708ec6db8 in term 1.
I20260805 22:37:45.955504 28055 consensus_queue.cc:237] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } }
I20260805 22:37:45.956524 27502 catalog_manager.cc:5495] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131). New cstate: current_term: 1 leader_uuid: "5d4b28b6c9154e1a905b585708ec6db8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d4b28b6c9154e1a905b585708ec6db8" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 38023 } health_report { overall_health: HEALTHY } } }
I20260805 22:37:45.968947 27805 raft_consensus.cc:1261] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Refusing update from remote peer 5d4b28b6c9154e1a905b585708ec6db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:45.969302 27662 raft_consensus.cc:1261] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Refusing update from remote peer 5d4b28b6c9154e1a905b585708ec6db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:37:45.969249 28077 consensus_queue.cc:1035] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a129bdfdf7c24771be22688f0d3eec06" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:45.969985 28077 consensus_queue.cc:1035] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198df2c03b5240799f0475ab677cb0fd" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:37:45.986891 27502 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:45.987382 27502 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:37:45.988615 27502 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64d9379a3f954c1caa3d82096b39ee2d: Sending DeleteTablet for 3 replicas of tablet e4567b5ec3c04fd192421a652952e802
I20260805 22:37:45.989069 27784 tablet_service.cc:1514] Processing DeleteTablet for tablet e4567b5ec3c04fd192421a652952e802 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:56688
I20260805 22:37:45.989157 27928 tablet_service.cc:1514] Processing DeleteTablet for tablet e4567b5ec3c04fd192421a652952e802 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:44448
I20260805 22:37:45.989214 27642 tablet_service.cc:1514] Processing DeleteTablet for tablet e4567b5ec3c04fd192421a652952e802 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:37:45 UTC) from {username='oryx', principal='oryx/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:49200
I20260805 22:37:45.989286 28050 tablet_replica.cc:330] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06: stopping tablet replica
I20260805 22:37:45.989346 28050 raft_consensus.cc:2229] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:45.989348 28048 tablet_replica.cc:330] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8: stopping tablet replica
I20260805 22:37:45.989403 28050 raft_consensus.cc:2258] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.989418 28048 raft_consensus.cc:2229] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:37:45.989485 28049 tablet_replica.cc:330] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd: stopping tablet replica
I20260805 22:37:45.989495 28048 raft_consensus.cc:2258] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.989545 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 27576
I20260805 22:37:45.989569 28049 raft_consensus.cc:2229] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:37:45.989625 28049 raft_consensus.cc:2258] T e4567b5ec3c04fd192421a652952e802 P 198df2c03b5240799f0475ab677cb0fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:37:45.990679 28050 ts_tablet_manager.cc:1905] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.992743 28048 ts_tablet_manager.cc:1905] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:37:45.994263 28050 ts_tablet_manager.cc:1918] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:45.994349 28050 log.cc:1196] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/e4567b5ec3c04fd192421a652952e802
I20260805 22:37:45.994778 28048 ts_tablet_manager.cc:1918] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:37:45.994751 28050 ts_tablet_manager.cc:1939] T e4567b5ec3c04fd192421a652952e802 P a129bdfdf7c24771be22688f0d3eec06: Deleting consensus metadata
I20260805 22:37:45.994863 28048 log.cc:1196] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/e4567b5ec3c04fd192421a652952e802
I20260805 22:37:45.995147 28048 ts_tablet_manager.cc:1939] T e4567b5ec3c04fd192421a652952e802 P 5d4b28b6c9154e1a905b585708ec6db8: Deleting consensus metadata
I20260805 22:37:45.995656 27488 catalog_manager.cc:4841] TS a129bdfdf7c24771be22688f0d3eec06 (127.19.77.130:41821): tablet e4567b5ec3c04fd192421a652952e802 (table test-table [id=86d86dbb24504b9eaa9087b9e923e97e]) successfully deleted
I20260805 22:37:45.995836 27488 catalog_manager.cc:4841] TS 5d4b28b6c9154e1a905b585708ec6db8 (127.19.77.131:38023): tablet e4567b5ec3c04fd192421a652952e802 (table test-table [id=86d86dbb24504b9eaa9087b9e923e97e]) successfully deleted
W20260805 22:37:46.003223 27487 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:42955 (error 108)
I20260805 22:37:46.003454 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 27718
I20260805 22:37:46.004913 28108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:46.003667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42955 (local address 127.0.0.1:49230)
0805 22:37:46.004802 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:46.004853 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:42955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1114,"thread_start_us":37,"threads_started":1}
W20260805 22:37:46.005304 27487 catalog_manager.cc:4584] TS 198df2c03b5240799f0475ab677cb0fd (127.19.77.129:42955): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e4567b5ec3c04fd192421a652952e802: Network error: Client connection negotiation failed: client connection to 127.19.77.129:42955: connect: Connection refused (error 111)
I20260805 22:37:46.011269 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 27862
I20260805 22:37:46.019821 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 27471
2026-08-05T22:37:46Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3076 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:46 dist-test-slave-chsk krb5kdc[28111](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:46 dist-test-slave-chsk krb5kdc[28111](info): set up 2 sockets
Aug 05 22:37:46 dist-test-slave-chsk krb5kdc[28111](info): commencing operation
krb5kdc: starting...
W20260805 22:37:47.169615 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:47 dist-test-slave-chsk krb5kdc[28111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:47.311342 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:36827
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:44581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:36827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:47.402684 28124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:47.402926 28124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:47.402951 28124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:47.404143 28124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:47.404191 28124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:47.404204 28124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:47.404217 28124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:47.404229 28124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:47.405758 28124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:44581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:36827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:36827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:47.405977 28124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:47.406173 28124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:47.411553 28131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:47.411476 28132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:47.411494 28134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:47.411813 28124 server_base.cc:1034] running on GCE node
I20260805 22:37:47.412107 28124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:47.412462 28124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:47.413653 28124 hybrid_clock.cc:648] HybridClock initialized: now 1785969467413650 us; error 48 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-05T22:37:47Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1393 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:37:47 dist-test-slave-chsk krb5kdc[28139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:37:47 dist-test-slave-chsk krb5kdc[28139](info): set up 2 sockets
Aug 05 22:37:47 dist-test-slave-chsk krb5kdc[28139](info): commencing operation
krb5kdc: starting...
W20260805 22:37:48.483673 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:37:48 dist-test-slave-chsk krb5kdc[28139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:37:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:37:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:37:48.619105 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43495
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:43495
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:48.703332 28152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:48.703568 28152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:48.703594 28152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:48.704804 28152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:48.704849 28152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:48.704864 28152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:48.704877 28152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:48.704890 28152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:48.706444 28152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:43495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:48.706730 28152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:48.706980 28152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:48.713021 28158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:48.712991 28157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:48.713088 28160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:48.713510 28152 server_base.cc:1034] running on GCE node
I20260805 22:37:48.713898 28152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:48.714234 28152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:48.715435 28152 hybrid_clock.cc:648] HybridClock initialized: now 1785969468715356 us; error 69 us; skew 500 ppm
Aug 05 22:37:48 dist-test-slave-chsk krb5kdc[28139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969468, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:48.723658 28152 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:48.724252 28152 webserver.cc:460] Webserver started at http://127.19.77.190:42191/ using document root <none> and password file <none>
I20260805 22:37:48.724531 28152 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:48.724606 28152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:48.724769 28152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:48.725960 28152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "b711fd51386e431db2fce9f6fb085943"
format_stamp: "Formatted at 2026-08-05 22:37:48 on dist-test-slave-chsk"
server_key: "cab9862891f608c632d9ba33ac346e22"
server_key_iv: "774bf98e97ef2b66a759fa37f875f569"
server_key_version: "encryptionkey@0"
I20260805 22:37:48.726364 28152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "b711fd51386e431db2fce9f6fb085943"
format_stamp: "Formatted at 2026-08-05 22:37:48 on dist-test-slave-chsk"
server_key: "cab9862891f608c632d9ba33ac346e22"
server_key_iv: "774bf98e97ef2b66a759fa37f875f569"
server_key_version: "encryptionkey@0"
I20260805 22:37:48.728188 28152 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260805 22:37:48.729279 28167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:48.729583 28152 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:48.729697 28152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "b711fd51386e431db2fce9f6fb085943"
format_stamp: "Formatted at 2026-08-05 22:37:48 on dist-test-slave-chsk"
server_key: "cab9862891f608c632d9ba33ac346e22"
server_key_iv: "774bf98e97ef2b66a759fa37f875f569"
server_key_version: "encryptionkey@0"
I20260805 22:37:48.729787 28152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:48.756384 28152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:48.759181 28152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:48.759366 28152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:48.764709 28152 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:43495
I20260805 22:37:48.764747 28219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:43495 every 8 connection(s)
I20260805 22:37:48.765146 28152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:48.766181 28220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:37:48.766135 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 28152
I20260805 22:37:48.766402 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:37:48.766680 19766 external_mini_cluster.cc:1428] Setting key e093ac02bbdc22ec18f39019861e4408
I20260805 22:37:48.769666 28220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943: Bootstrap starting.
I20260805 22:37:48.770460 28220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943: Neither blocks nor log segments found. Creating new log.
I20260805 22:37:48.770876 28220 log.cc:824] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:48.771850 28220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943: No bootstrap required, opened a new log
Aug 05 22:37:48 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:48.774726 28220 raft_consensus.cc:348] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } }
I20260805 22:37:48.774932 28220 raft_consensus.cc:374] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:37:48.774983 28220 raft_consensus.cc:729] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b711fd51386e431db2fce9f6fb085943, State: Initialized, Role: FOLLOWER
I20260805 22:37:48.775184 28220 consensus_queue.cc:260] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } }
I20260805 22:37:48.775285 28220 raft_consensus.cc:388] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:48.775332 28220 raft_consensus.cc:482] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:48.775382 28220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:37:48.776018 28220 raft_consensus.cc:504] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } }
I20260805 22:37:48.776156 28220 leader_election.cc:302] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b711fd51386e431db2fce9f6fb085943; no voters:
I20260805 22:37:48.776382 28220 leader_election.cc:288] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:37:48.776424 28225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:37:48.776551 28225 raft_consensus.cc:686] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 1 LEADER]: Becoming Leader. State: Replica: b711fd51386e431db2fce9f6fb085943, State: Running, Role: LEADER
I20260805 22:37:48.776700 28220 sys_catalog.cc:564] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:48.776718 28225 consensus_queue.cc:237] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } }
I20260805 22:37:48.777215 28227 sys_catalog.cc:455] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b711fd51386e431db2fce9f6fb085943. Latest consensus state: current_term: 1 leader_uuid: "b711fd51386e431db2fce9f6fb085943" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } } }
I20260805 22:37:48.777225 28226 sys_catalog.cc:455] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b711fd51386e431db2fce9f6fb085943" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } } }
I20260805 22:37:48.777407 28227 sys_catalog.cc:458] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:48.777456 28226 sys_catalog.cc:458] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:48.777869 28229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:48.778461 28229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:48.780441 28223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:48.767711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54258 (local address 127.19.77.190:43495)
0805 22:37:48.768043 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:48.768053 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:48.768081 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:37:48.768533 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:48.768539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:48.768589 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:48.768717 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:48.769634 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:48.770676 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:48.771746 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:48.772346 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:48.772445 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:48.775496 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:48.775500 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:48.775501 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:48.775513 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:48.778161 (+ 2648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:48.778658 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:48.778661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:48.778661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:48.778743 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:48.778979 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:48.778980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:48.778980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:48.779370 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:48.779504 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:48.780152 (+ 648us) server_negotiation.cc:299] Negotiation successful
0805 22:37:48.780286 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":152,"threads_started":1}
I20260805 22:37:48.783784 28229 catalog_manager.cc:1347] Generated new cluster ID: 3d60009815bc48b3adccd1c149c8b736
I20260805 22:37:48.783852 28229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:48.787681 28229 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:37:48.788477 28229 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:48.795441 28229 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943: Generated new TSK 0
I20260805 22:37:48.795679 28229 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:37:48.831597 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43495
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:48.930131 28247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:48.930363 28247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:48.930392 28247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:48.931777 28247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:48.931833 28247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:48.931864 28247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:48.933512 28247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:48.933804 28247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:48.934108 28247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:48.939949 28253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:48.939956 28255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:48.939956 28252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:48.940214 28247 server_base.cc:1034] running on GCE node
I20260805 22:37:48.940424 28247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:48.940728 28247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:48.941929 28247 hybrid_clock.cc:648] HybridClock initialized: now 1785969468941924 us; error 51 us; skew 500 ppm
Aug 05 22:37:48 dist-test-slave-chsk krb5kdc[28139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969468, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:48.944944 28247 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:37:48.945427 28247 webserver.cc:460] Webserver started at http://127.19.77.129:42697/ using document root <none> and password file <none>
I20260805 22:37:48.945655 28247 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:48.945700 28247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:48.945796 28247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:48.946923 28247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "5f6957e96ecd48a7bf2d6179f0b4c200"
format_stamp: "Formatted at 2026-08-05 22:37:48 on dist-test-slave-chsk"
server_key: "3cdf24473a3ff91cf0ea4dca402e2237"
server_key_iv: "88d55ec7f5bf7da8ea221de307ca6d31"
server_key_version: "encryptionkey@0"
I20260805 22:37:48.947355 28247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "5f6957e96ecd48a7bf2d6179f0b4c200"
format_stamp: "Formatted at 2026-08-05 22:37:48 on dist-test-slave-chsk"
server_key: "3cdf24473a3ff91cf0ea4dca402e2237"
server_key_iv: "88d55ec7f5bf7da8ea221de307ca6d31"
server_key_version: "encryptionkey@0"
I20260805 22:37:48.948935 28247 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:48.950047 28262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:48.950482 28247 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:48.950588 28247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "5f6957e96ecd48a7bf2d6179f0b4c200"
format_stamp: "Formatted at 2026-08-05 22:37:48 on dist-test-slave-chsk"
server_key: "3cdf24473a3ff91cf0ea4dca402e2237"
server_key_iv: "88d55ec7f5bf7da8ea221de307ca6d31"
server_key_version: "encryptionkey@0"
I20260805 22:37:48.950668 28247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:48.963786 28247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:48.967515 28247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:48.967665 28247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:48.967893 28247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:48.968202 28247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:48.968236 28247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:48.968261 28247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:48.968273 28247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:48.976879 28247 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:41139
I20260805 22:37:48.976946 28376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:41139 every 8 connection(s)
I20260805 22:37:48.977295 28247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:48.979367 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 28247
I20260805 22:37:48.979488 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:37:48.979738 19766 external_mini_cluster.cc:1428] Setting key 16f50e6d1015d336dac067e06a04081d
Aug 05 22:37:48 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969468, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:37:48.991587 28223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:48.978375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:55763 (local address 127.19.77.190:43495)
0805 22:37:48.978445 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:48.978447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:48.978812 (+ 365us) server_negotiation.cc:407] Connection header received
0805 22:37:48.979694 (+ 882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:48.979695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:48.979707 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:48.979764 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:48.981911 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:48.982432 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:48.983823 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:48.984170 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:48.984233 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:48.987392 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:48.987394 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:48.987394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:48.987402 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:48.989424 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:48.990099 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:48.990102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:48.990102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:48.990356 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:48.990774 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:48.990775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:48.990775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:48.990928 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:48.990989 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:48.991427 (+ 438us) server_negotiation.cc:299] Negotiation successful
0805 22:37:48.991514 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:37:48.991793 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:48.978335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:55763)
0805 22:37:48.978653 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:48.978706 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:48.979496 (+ 790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:48.979855 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:48.979860 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:48.981333 (+ 1473us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:48.981777 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:48.981787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:48.982537 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:48.982538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:48.983724 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:48.983727 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:48.984305 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:48.984307 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:48.984482 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:48.985156 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:48.985168 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:48.987237 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:48.989544 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:48.989555 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:48.989558 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:48.989916 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:48.990475 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:48.990476 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:48.990477 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:48.990642 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:48.991009 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:48.991017 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:48.991261 (+ 244us) client_negotiation.cc:769] Sending connection context
0805 22:37:48.991384 (+ 123us) client_negotiation.cc:240] Negotiation successful
0805 22:37:48.991549 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":202,"threads_started":1}
I20260805 22:37:48.992385 28377 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43495
I20260805 22:37:48.992489 28377 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:48.992709 28377 heartbeater.cc:511] Master 127.19.77.190:43495 requested a full tablet report, sending...
I20260805 22:37:48.993252 28184 ts_manager.cc:194] Registered new tserver with Master: 5f6957e96ecd48a7bf2d6179f0b4c200 (127.19.77.129:41139)
I20260805 22:37:48.993894 28184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:55763
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:37:49.015105 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43495
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:49.111025 28382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:49.111347 28382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:49.111379 28382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:49.112705 28382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:49.112761 28382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:49.112790 28382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:49.114408 28382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:49.114706 28382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:49.114959 28382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:49.120517 28388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:49.120630 28387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:49.120534 28390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:49.121197 28382 server_base.cc:1034] running on GCE node
I20260805 22:37:49.121526 28382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:49.121832 28382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:49.123039 28382 hybrid_clock.cc:648] HybridClock initialized: now 1785969469123041 us; error 53 us; skew 500 ppm
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969469, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:49.126158 28382 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:37:49.126714 28382 webserver.cc:460] Webserver started at http://127.19.77.130:38709/ using document root <none> and password file <none>
I20260805 22:37:49.126969 28382 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:49.127039 28382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:49.127244 28382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:49.128407 28382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "acc5660089854497ab2581ac0684849d"
format_stamp: "Formatted at 2026-08-05 22:37:49 on dist-test-slave-chsk"
server_key: "d397088c135f20ed5b61586e1535d281"
server_key_iv: "3629350f3bdbb7023dc0a82a01776559"
server_key_version: "encryptionkey@0"
I20260805 22:37:49.128808 28382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "acc5660089854497ab2581ac0684849d"
format_stamp: "Formatted at 2026-08-05 22:37:49 on dist-test-slave-chsk"
server_key: "d397088c135f20ed5b61586e1535d281"
server_key_iv: "3629350f3bdbb7023dc0a82a01776559"
server_key_version: "encryptionkey@0"
I20260805 22:37:49.130398 28382 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:37:49.131409 28397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.131780 28382 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:49.131937 28382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "acc5660089854497ab2581ac0684849d"
format_stamp: "Formatted at 2026-08-05 22:37:49 on dist-test-slave-chsk"
server_key: "d397088c135f20ed5b61586e1535d281"
server_key_iv: "3629350f3bdbb7023dc0a82a01776559"
server_key_version: "encryptionkey@0"
I20260805 22:37:49.132050 28382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:49.151362 28382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:49.154773 28382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:49.155000 28382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:49.155432 28382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:49.155867 28382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:49.155908 28382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.155936 28382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:49.155948 28382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.165843 28382 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:34875
I20260805 22:37:49.165971 28513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:34875 every 8 connection(s)
I20260805 22:37:49.166296 28382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:49.173220 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 28382
I20260805 22:37:49.173322 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969469, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:49.173563 19766 external_mini_cluster.cc:1428] Setting key f9bd22a639750ac7714b72443f1ff8ab
I20260805 22:37:49.178712 28223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:49.167187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:55945 (local address 127.19.77.190:43495)
0805 22:37:49.167249 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:49.167251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:49.167502 (+ 251us) server_negotiation.cc:407] Connection header received
0805 22:37:49.168150 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:49.168152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:49.168171 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:49.168273 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:49.169420 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.169948 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.171060 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.171284 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.171346 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.174145 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:49.174147 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:49.174148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:49.174159 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:49.176592 (+ 2433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:49.177299 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:49.177300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:49.177301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:49.177411 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:49.177715 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:49.177716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:49.177717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:49.177933 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:49.178033 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:49.178463 (+ 430us) server_negotiation.cc:299] Negotiation successful
0805 22:37:49.178599 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:37:49.179005 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:49.167104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:55945)
0805 22:37:49.167317 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:49.167363 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:49.167931 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:49.168368 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:49.168372 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:49.169017 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:49.169269 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.169274 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.170065 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.170066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.170954 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.170956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.171367 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.171368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.171489 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.172192 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:49.172201 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:49.174023 (+ 1822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:49.176833 (+ 2810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:49.176845 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:49.176847 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:49.177173 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:49.177500 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:49.177501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:49.177501 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:49.177628 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:49.178032 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:49.178054 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:49.178283 (+ 229us) client_negotiation.cc:769] Sending connection context
0805 22:37:49.178427 (+ 144us) client_negotiation.cc:240] Negotiation successful
0805 22:37:49.178674 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":131,"threads_started":1}
I20260805 22:37:49.179721 28514 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43495
I20260805 22:37:49.179880 28514 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:49.180166 28514 heartbeater.cc:511] Master 127.19.77.190:43495 requested a full tablet report, sending...
I20260805 22:37:49.180764 28184 ts_manager.cc:194] Registered new tserver with Master: acc5660089854497ab2581ac0684849d (127.19.77.130:34875)
I20260805 22:37:49.181408 28184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:55945
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:37:49.211882 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43495
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:49.313138 28519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:49.313378 28519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:49.313405 28519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:49.314595 28519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:49.314640 28519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:49.314666 28519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:49.316269 28519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:49.316490 28519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:49.316712 28519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:49.322602 28524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:49.322621 28525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:49.322870 28527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:49.322935 28519 server_base.cc:1034] running on GCE node
I20260805 22:37:49.323240 28519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:49.323513 28519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:49.324716 28519 hybrid_clock.cc:648] HybridClock initialized: now 1785969469324691 us; error 51 us; skew 500 ppm
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969469, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:49.327891 28519 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:37:49.328379 28519 webserver.cc:460] Webserver started at http://127.19.77.131:43455/ using document root <none> and password file <none>
I20260805 22:37:49.328655 28519 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:49.328708 28519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:49.328886 28519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:37:49.330184 28519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "4b036bd670a0430db788b08621e37ec5"
format_stamp: "Formatted at 2026-08-05 22:37:49 on dist-test-slave-chsk"
server_key: "78998606e7ea9a40853051863a355004"
server_key_iv: "b19400e49d6e54e679863f598b5f1d9e"
server_key_version: "encryptionkey@0"
I20260805 22:37:49.330628 28519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "4b036bd670a0430db788b08621e37ec5"
format_stamp: "Formatted at 2026-08-05 22:37:49 on dist-test-slave-chsk"
server_key: "78998606e7ea9a40853051863a355004"
server_key_iv: "b19400e49d6e54e679863f598b5f1d9e"
server_key_version: "encryptionkey@0"
I20260805 22:37:49.332907 28519 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260805 22:37:49.333963 28534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.334278 28519 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:49.334416 28519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "4b036bd670a0430db788b08621e37ec5"
format_stamp: "Formatted at 2026-08-05 22:37:49 on dist-test-slave-chsk"
server_key: "78998606e7ea9a40853051863a355004"
server_key_iv: "b19400e49d6e54e679863f598b5f1d9e"
server_key_version: "encryptionkey@0"
I20260805 22:37:49.334507 28519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:49.345291 28519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:49.348781 28519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:49.349045 28519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:49.349370 28519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:49.349731 28519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:49.349792 28519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.349840 28519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:49.349870 28519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.359210 28519 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:43931
I20260805 22:37:49.359287 28647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:43931 every 8 connection(s)
I20260805 22:37:49.359681 28519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:37:49.360131 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 28519
I20260805 22:37:49.360255 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:37:49.360471 19766 external_mini_cluster.cc:1428] Setting key 52b3ac2ccdc0b06aaf1a7bac101f7a2e
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969469, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:37:49.370951 28223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:49.360671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:43609 (local address 127.19.77.190:43495)
0805 22:37:49.360753 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:49.360755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:49.360905 (+ 150us) server_negotiation.cc:407] Connection header received
0805 22:37:49.361598 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:49.361598 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:49.361608 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:49.361655 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:49.362680 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.363258 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.364316 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.364508 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.364573 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.367244 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:49.367246 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:49.367246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:49.367253 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:49.368761 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:49.369567 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:49.369568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:49.369569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:49.369640 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:49.370010 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:49.370013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:49.370013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:49.370291 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:49.370530 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:49.370785 (+ 255us) server_negotiation.cc:299] Negotiation successful
0805 22:37:49.370869 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260805 22:37:49.371172 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:49.360574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:43609)
0805 22:37:49.360781 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:49.360826 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:49.361463 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:49.361732 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:49.361736 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:49.362357 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:49.362576 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.362581 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.363349 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.363350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.364219 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.364222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.364593 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.364594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.364699 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.365274 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:49.365283 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:49.367064 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:37:49.368904 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:49.368921 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:49.368924 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:49.369432 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:49.369712 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:37:49.369713 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:37:49.369713 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:37:49.369861 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:37:49.370434 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:37:49.370441 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:37:49.370579 (+ 138us) client_negotiation.cc:769] Sending connection context
0805 22:37:49.370741 (+ 162us) client_negotiation.cc:240] Negotiation successful
0805 22:37:49.370898 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":123,"threads_started":1}
I20260805 22:37:49.371721 28648 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43495
I20260805 22:37:49.371840 28648 heartbeater.cc:464] Registering TS with master...
I20260805 22:37:49.372068 28648 heartbeater.cc:511] Master 127.19.77.190:43495 requested a full tablet report, sending...
I20260805 22:37:49.372479 28183 ts_manager.cc:194] Registered new tserver with Master: 4b036bd670a0430db788b08621e37ec5 (127.19.77.131:43931)
I20260805 22:37:49.372895 28183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:43609
I20260805 22:37:49.383991 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab.
Entry for principal oryx/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab.
WARNING: no policy specified for oryx/127.19.77.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab.
Entry for principal oryx/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab.
WARNING: no policy specified for oryx/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab.
Entry for principal oryx/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab.
I20260805 22:37:49.475220 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 28247
I20260805 22:37:49.481796 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 28382
I20260805 22:37:49.488577 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 28519
I20260805 22:37:49.494549 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 28152
I20260805 22:37:49.501832 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43495
--webserver_interface=127.19.77.190
--webserver_port=42191
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:43495
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:37:49.594517 28657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:49.594763 28657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:49.594789 28657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:49.596484 28657 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:37:49.596556 28657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:49.596575 28657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:49.596588 28657 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:37:49.596602 28657 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:37:49.598789 28657 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:43495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=42191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:49.599431 28657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:49.599862 28657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:49.605986 28666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:49.605970 28664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:49.605978 28662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:49.606494 28657 server_base.cc:1034] running on GCE node
I20260805 22:37:49.606818 28657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:49.607213 28657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:49.608403 28657 hybrid_clock.cc:648] HybridClock initialized: now 1785969469608382 us; error 40 us; skew 500 ppm
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969469, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:49.611804 28657 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:37:49.612543 28657 webserver.cc:460] Webserver started at http://127.19.77.190:42191/ using document root <none> and password file <none>
I20260805 22:37:49.612840 28657 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:49.612949 28657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:49.614913 28657 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260805 22:37:49.616377 28673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.616752 28657 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:49.616886 28657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "b711fd51386e431db2fce9f6fb085943"
format_stamp: "Formatted at 2026-08-05 22:37:48 on dist-test-slave-chsk"
server_key: "cab9862891f608c632d9ba33ac346e22"
server_key_iv: "774bf98e97ef2b66a759fa37f875f569"
server_key_version: "encryptionkey@0"
I20260805 22:37:49.617333 28657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:49.625300 28657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:49.628454 28657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:49.628676 28657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:49.633579 28657 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:43495
I20260805 22:37:49.633636 28727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:43495 every 8 connection(s)
I20260805 22:37:49.634071 28657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:37:49.636415 28728 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:37:49.637318 28728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943: Bootstrap starting.
I20260805 22:37:49.638193 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 28657
I20260805 22:37:49.638756 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:41139
--local_ip_for_outbound_sockets=127.19.77.129
--tserver_master_addrs=127.19.77.190:43495
--webserver_port=42697
--webserver_interface=127.19.77.129
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.77.129
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:37:49.651350 28728 log.cc:824] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943: Log is configured to *not* fsync() on all Append() calls
I20260805 22:37:49.653213 28728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:37:49.653650 28728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943: Bootstrap complete.
I20260805 22:37:49.656338 28728 raft_consensus.cc:348] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } }
I20260805 22:37:49.656595 28728 raft_consensus.cc:729] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b711fd51386e431db2fce9f6fb085943, State: Initialized, Role: FOLLOWER
I20260805 22:37:49.656790 28728 consensus_queue.cc:260] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } }
I20260805 22:37:49.656901 28728 raft_consensus.cc:388] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:37:49.656957 28728 raft_consensus.cc:482] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:37:49.657037 28728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:37:49.658717 28728 raft_consensus.cc:504] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } }
I20260805 22:37:49.658924 28728 leader_election.cc:302] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b711fd51386e431db2fce9f6fb085943; no voters:
I20260805 22:37:49.659377 28728 leader_election.cc:288] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:37:49.659423 28732 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:37:49.659627 28732 raft_consensus.cc:686] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [term 2 LEADER]: Becoming Leader. State: Replica: b711fd51386e431db2fce9f6fb085943, State: Running, Role: LEADER
I20260805 22:37:49.659811 28728 sys_catalog.cc:564] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:37:49.659912 28732 consensus_queue.cc:237] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } }
I20260805 22:37:49.660415 28734 sys_catalog.cc:455] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b711fd51386e431db2fce9f6fb085943" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } } }
I20260805 22:37:49.660461 28733 sys_catalog.cc:455] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b711fd51386e431db2fce9f6fb085943. Latest consensus state: current_term: 2 leader_uuid: "b711fd51386e431db2fce9f6fb085943" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b711fd51386e431db2fce9f6fb085943" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43495 } } }
I20260805 22:37:49.660539 28734 sys_catalog.cc:458] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:49.660568 28733 sys_catalog.cc:458] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943 [sys.catalog]: This master's current role is: LEADER
I20260805 22:37:49.660853 28741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:37:49.661568 28741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:37:49.661764 28741 catalog_manager.cc:1259] Loaded cluster ID: 3d60009815bc48b3adccd1c149c8b736
I20260805 22:37:49.661856 28741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:37:49.663132 28741 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:37:49.663421 28741 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b711fd51386e431db2fce9f6fb085943: Loaded TSK: 0
I20260805 22:37:49.663910 28741 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:37:49.736861 28730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:49.737221 28730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:49.737275 28730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:49.739039 28730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:49.739126 28730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:49.739215 28730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:37:49.741428 28730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.129.keytab
--principal=oryx/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:41139
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=42697
--tserver_master_addrs=127.19.77.190:43495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:49.741858 28730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:49.742182 28730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:49.748961 28754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:49.749390 28730 server_base.cc:1034] running on GCE node
W20260805 22:37:49.749531 28755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:49.750948 28757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:49.751319 28730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:49.751674 28730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:49.752846 28730 hybrid_clock.cc:648] HybridClock initialized: now 1785969469752810 us; error 37 us; skew 500 ppm
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969469, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:49.756258 28730 init.cc:377] Logged in from keytab as oryx/127.19.77.129@KRBTEST.COM (short username oryx)
I20260805 22:37:49.756857 28730 webserver.cc:460] Webserver started at http://127.19.77.129:42697/ using document root <none> and password file <none>
I20260805 22:37:49.757104 28730 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:49.757164 28730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:49.758625 28730 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:49.759372 28764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.759618 28730 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:49.759727 28730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "5f6957e96ecd48a7bf2d6179f0b4c200"
format_stamp: "Formatted at 2026-08-05 22:37:48 on dist-test-slave-chsk"
server_key: "3cdf24473a3ff91cf0ea4dca402e2237"
server_key_iv: "88d55ec7f5bf7da8ea221de307ca6d31"
server_key_version: "encryptionkey@0"
I20260805 22:37:49.760260 28730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:49.785722 28730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:49.788180 28730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:49.788434 28730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:49.788728 28730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:49.789074 28730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:49.789131 28730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.789166 28730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:49.789193 28730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.797199 28730 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:41139
I20260805 22:37:49.797290 28879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:41139 every 8 connection(s)
I20260805 22:37:49.797833 28730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:37:49.800468 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 28730
I20260805 22:37:49.800827 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:34875
--local_ip_for_outbound_sockets=127.19.77.130
--tserver_master_addrs=127.19.77.190:43495
--webserver_port=38709
--webserver_interface=127.19.77.130
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.77.130
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:49.809131 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:49.798810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:54307)
0805 22:37:49.799058 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:49.799114 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:49.799825 (+ 711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:49.800482 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:49.800487 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:49.801476 (+ 989us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:49.801699 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.801707 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.803166 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.803168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.804280 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.804284 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.805046 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.805048 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.805196 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.805854 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:49.805865 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:49.808876 (+ 3011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":120,"threads_started":1}
W20260805 22:37:49.809197 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:49.798930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:54307 (local address 127.19.77.190:43495)
0805 22:37:49.799274 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:49.799284 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:49.799320 (+ 36us) server_negotiation.cc:407] Connection header received
0805 22:37:49.800136 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:49.800144 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:49.800200 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:49.800416 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:49.801870 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.803009 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.804403 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.804936 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.805040 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.809041 (+ 4001us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:54307: BlockingRecv error: recv got EOF from 127.19.77.129:54307 (error 108)
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":106,"threads_started":1}
W20260805 22:37:49.809433 28880 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:43495 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.77.190:43495: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:49.816236 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:49.809675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:57611)
0805 22:37:49.809842 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:49.809855 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:49.809919 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:49.810173 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:49.810175 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:49.810402 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:49.810495 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.810497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.811626 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.811628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.812221 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.812224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.812944 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.812946 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.813040 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.813865 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:49.813871 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:49.816175 (+ 2304us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":124,"threads_started":1}
W20260805 22:37:49.816372 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:49.809760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:57611 (local address 127.19.77.190:43495)
0805 22:37:49.809829 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:49.809831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:49.809896 (+ 65us) server_negotiation.cc:407] Connection header received
0805 22:37:49.809971 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:49.809972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:49.809989 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:49.810076 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:49.810620 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.811489 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.812433 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.812789 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.812903 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.816305 (+ 3402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:57611: BlockingRecv error: recv got EOF from 127.19.77.129:57611 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:49.822417 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:49.816516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:35371)
0805 22:37:49.816593 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:49.816603 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:49.816644 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:49.816845 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:49.816846 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:49.816961 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:49.817001 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.817002 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.818037 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.818039 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.818746 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.818749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.819277 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.819278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.819347 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.820142 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:49.820147 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:49.822357 (+ 2210us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
W20260805 22:37:49.822554 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:49.816572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:35371 (local address 127.19.77.190:43495)
0805 22:37:49.816726 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:49.816728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:49.816736 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:37:49.816759 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:49.816760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:49.816771 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:49.816830 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:49.817072 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.817850 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.818831 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.819167 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.819243 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.822480 (+ 3237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:35371: BlockingRecv error: recv got EOF from 127.19.77.129:35371 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":113,"threads_started":1}
W20260805 22:37:49.822669 28880 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:37:49.894577 28884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:49.894845 28884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:49.894876 28884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:49.896209 28884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:49.896257 28884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:49.896287 28884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:37:49.897799 28884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.130.keytab
--principal=oryx/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:34875
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=38709
--tserver_master_addrs=127.19.77.190:43495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:49.898031 28884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:49.898239 28884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:49.903855 28892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:49.904068 28894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:49.904068 28891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:49.904549 28884 server_base.cc:1034] running on GCE node
I20260805 22:37:49.904786 28884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:49.905072 28884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:49.906304 28884 hybrid_clock.cc:648] HybridClock initialized: now 1785969469906296 us; error 47 us; skew 500 ppm
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969469, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:49.909186 28884 init.cc:377] Logged in from keytab as oryx/127.19.77.130@KRBTEST.COM (short username oryx)
I20260805 22:37:49.909694 28884 webserver.cc:460] Webserver started at http://127.19.77.130:38709/ using document root <none> and password file <none>
I20260805 22:37:49.909948 28884 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:49.910022 28884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:49.911576 28884 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:37:49.912274 28901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.912494 28884 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:37:49.912595 28884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "acc5660089854497ab2581ac0684849d"
format_stamp: "Formatted at 2026-08-05 22:37:49 on dist-test-slave-chsk"
server_key: "d397088c135f20ed5b61586e1535d281"
server_key_iv: "3629350f3bdbb7023dc0a82a01776559"
server_key_version: "encryptionkey@0"
I20260805 22:37:49.912951 28884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:49.924893 28884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:49.927507 28884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:49.927646 28884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:49.927863 28884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:49.928330 28884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:49.928383 28884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.928407 28884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:49.928432 28884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:49.935802 28884 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:34875
I20260805 22:37:49.935889 29016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:34875 every 8 connection(s)
I20260805 22:37:49.936278 28884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:37:49.940809 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 28884
I20260805 22:37:49.941155 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:43931
--local_ip_for_outbound_sockets=127.19.77.131
--tserver_master_addrs=127.19.77.190:43495
--webserver_port=43455
--webserver_interface=127.19.77.131
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.77.131
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:37:49.945391 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:49.937108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:34685 (local address 127.19.77.190:43495)
0805 22:37:49.937348 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:49.937351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:49.937554 (+ 203us) server_negotiation.cc:407] Connection header received
0805 22:37:49.938145 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:49.938146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:49.938163 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:49.938219 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:49.939260 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.939773 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.941126 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.941516 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.941620 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.945339 (+ 3719us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:34685: BlockingRecv error: recv got EOF from 127.19.77.130:34685 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
I20260805 22:37:49.945446 29019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:49.937089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:34685)
0805 22:37:49.937403 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:49.937457 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:49.937994 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:49.938294 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:49.938298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:49.938915 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:49.939130 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.939159 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.939888 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.939889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.940952 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.940956 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.941658 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.941659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.941838 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.942479 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:49.942490 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:49.945195 (+ 2705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":98,"threads_started":1}
W20260805 22:37:49.945694 29017 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:43495 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.77.190:43495: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:49.952279 29021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:49.945932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:44021)
0805 22:37:49.946097 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:49.946111 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:49.946185 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:49.946341 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:49.946341 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:49.946503 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:49.946593 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.946595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.947755 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.947757 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.948524 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.948534 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.949255 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.949256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.949315 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.949894 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:49.949899 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:49.952151 (+ 2252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":99,"threads_started":1}
W20260805 22:37:49.952373 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:49.946047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:44021 (local address 127.19.77.190:43495)
0805 22:37:49.946101 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:49.946103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:49.946166 (+ 63us) server_negotiation.cc:407] Connection header received
0805 22:37:49.946261 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:49.946262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:49.946272 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:49.946331 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:49.946714 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.947589 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.948673 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.949111 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.949205 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.952286 (+ 3081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:44021: BlockingRecv error: recv got EOF from 127.19.77.130:44021 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:49 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:49.957903 29019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:49.952686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:45401)
0805 22:37:49.952755 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:49.952768 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:49.952820 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:49.952975 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:49.952976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:49.953121 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:49.953162 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.953164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.954168 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.954169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.954694 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:49.954695 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.955246 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.955247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:49.955296 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.955846 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:49.955851 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:49.957845 (+ 1994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260805 22:37:49.958114 29017 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:37:49.958235 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:49.952769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:45401 (local address 127.19.77.190:43495)
0805 22:37:49.952843 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:49.952845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:49.952856 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:49.952885 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:49.952886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:49.952898 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:49.952970 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:49.953243 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.954068 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.954780 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:49.955126 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:49.955236 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:49.957964 (+ 2728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:45401: BlockingRecv error: recv got EOF from 127.19.77.130:45401 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260805 22:37:50.035619 29020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:37:50.035844 29020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:37:50.035872 29020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:37:50.037024 29020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:37:50.037063 29020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:37:50.037091 29020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:37:50.038511 29020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/krb5kdc/oryx_127.19.77.131.keytab
--principal=oryx/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:43931
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=43455
--tserver_master_addrs=127.19.77.190:43495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:37:50.038712 29020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:37:50.038898 29020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:37:50.044229 29026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:37:50.044229 29027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:50.044399 29020 server_base.cc:1034] running on GCE node
W20260805 22:37:50.044269 29029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:37:50.044690 29020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:37:50.044965 29020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:37:50.046146 29020 hybrid_clock.cc:648] HybridClock initialized: now 1785969470046116 us; error 55 us; skew 500 ppm
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969470, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:37:50.048949 29020 init.cc:377] Logged in from keytab as oryx/127.19.77.131@KRBTEST.COM (short username oryx)
I20260805 22:37:50.049463 29020 webserver.cc:460] Webserver started at http://127.19.77.131:43455/ using document root <none> and password file <none>
I20260805 22:37:50.049660 29020 fs_manager.cc:359] Metadata directory not provided
I20260805 22:37:50.049714 29020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:37:50.051082 29020 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:37:50.051769 29036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:50.051954 29020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:37:50.052052 29020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "4b036bd670a0430db788b08621e37ec5"
format_stamp: "Formatted at 2026-08-05 22:37:49 on dist-test-slave-chsk"
server_key: "78998606e7ea9a40853051863a355004"
server_key_iv: "b19400e49d6e54e679863f598b5f1d9e"
server_key_version: "encryptionkey@0"
I20260805 22:37:50.052399 29020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:37:50.062033 29020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:37:50.064459 29020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:37:50.064585 29020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:37:50.064800 29020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:37:50.065132 29020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:37:50.065171 29020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:50.065217 29020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:37:50.065243 29020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:37:50.071339 29020 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:43931
I20260805 22:37:50.071424 29149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:43931 every 8 connection(s)
I20260805 22:37:50.071796 29020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:50.079238 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 29020
W20260805 22:37:50.080027 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:50.072663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:46703 (local address 127.19.77.190:43495)
0805 22:37:50.072741 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:50.072744 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:50.072959 (+ 215us) server_negotiation.cc:407] Connection header received
0805 22:37:50.073438 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:50.073440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:50.073450 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:50.073506 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:50.074437 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.074925 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.075985 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.076182 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.076240 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.079970 (+ 3730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:46703: BlockingRecv error: recv got EOF from 127.19.77.131:46703 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:37:50.080099 29152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:50.072670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:46703)
0805 22:37:50.072820 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:50.072860 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:50.073342 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:50.073561 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:50.073564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:50.074145 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:50.074346 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:50.074350 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.075021 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.075022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:50.075903 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:50.075906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.076263 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.076263 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:50.076369 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.076962 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:50.076971 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:50.079870 (+ 2899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
W20260805 22:37:50.080428 29150 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:43495 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.77.190:43495: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:50.085455 29152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:50.080705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:51895)
0805 22:37:50.080771 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:50.080783 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:50.080837 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:50.080965 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:50.080965 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:50.081083 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:50.081134 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:50.081135 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.081882 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.081883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:50.082418 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:50.082420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.082802 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.082803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:50.082875 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.083411 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:50.083417 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:50.085369 (+ 1952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260805 22:37:50.085587 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:50.080751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:51895 (local address 127.19.77.190:43495)
0805 22:37:50.080799 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:50.080801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:50.080823 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:37:50.080881 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:50.080882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:50.080893 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:50.080956 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:50.081235 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.081789 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.082508 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.082725 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.082805 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.085482 (+ 2677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:51895: BlockingRecv error: recv got EOF from 127.19.77.131:51895 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:37:50.088344 28886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:50.079962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54274 (local address 127.19.77.190:43495)
0805 22:37:50.080023 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:50.080025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:50.080051 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:37:50.080076 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:50.080077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:50.080089 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:50.080157 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:50.081206 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.081784 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.082601 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.082805 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.082884 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.084504 (+ 1620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:37:50.084511 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:37:50.084511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:37:50.084529 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:37:50.086781 (+ 2252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:50.087122 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:50.087125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:50.087126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:50.087291 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:37:50.087520 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:37:50.087522 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:37:50.087522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:37:50.087773 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:37:50.087941 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 22:37:50.088047 (+ 106us) server_negotiation.cc:299] Negotiation successful
0805 22:37:50.088165 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":26}
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:50.090703 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:50.085725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:52131)
0805 22:37:50.085926 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:50.085938 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:50.086000 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:50.086120 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:50.086121 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:50.086284 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:50.086342 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:50.086343 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.087234 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.087235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:50.087787 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:50.087789 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.088191 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.088193 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:50.088254 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.088657 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:50.088662 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:50.090599 (+ 1937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":146,"threads_started":1}
W20260805 22:37:50.090742 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:50.085772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:52131 (local address 127.19.77.190:43495)
0805 22:37:50.085837 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:50.085839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:50.086009 (+ 170us) server_negotiation.cc:407] Connection header received
0805 22:37:50.086035 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:50.086036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:50.086046 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:50.086109 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:50.086415 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.087110 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.087876 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.088076 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.088165 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.090680 (+ 2515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:52131: BlockingRecv error: recv got EOF from 127.19.77.131:52131 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260805 22:37:50.090881 29150 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:50.829233 29155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:50.823131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:46489)
0805 22:37:50.823322 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:50.823338 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:50.823392 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:50.823616 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:50.823617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:50.823792 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:50.823848 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:50.823850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.824947 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.824949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:50.825773 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:50.825777 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.826229 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.826230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:50.826281 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.826979 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:50.826983 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:50.829153 (+ 2170us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":100,"threads_started":1}
W20260805 22:37:50.829481 29156 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:50.823313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:46489 (local address 127.19.77.190:43495)
0805 22:37:50.823449 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:50.823453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:50.823467 (+ 14us) server_negotiation.cc:407] Connection header received
0805 22:37:50.823490 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:50.823491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:50.823501 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:50.823573 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:50.824051 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.824790 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.825905 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.826128 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.826197 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.829403 (+ 3206us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:46489: BlockingRecv error: recv got EOF from 127.19.77.129:46489 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:50 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:50.964026 29157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:50.958568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:44555)
0805 22:37:50.958734 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:50.958751 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:50.958813 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:50.959007 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:50.959008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:50.959270 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:50.959366 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:50.959369 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.960186 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.960187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:50.960808 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:50.960810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.961282 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.961283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:50.961333 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.961897 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:50.961902 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:50.963907 (+ 2005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":105,"threads_started":1}
W20260805 22:37:50.964224 29156 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:50.958640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:44555 (local address 127.19.77.190:43495)
0805 22:37:50.958711 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:50.958715 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:50.958811 (+ 96us) server_negotiation.cc:407] Connection header received
0805 22:37:50.958869 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:50.958870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:50.958882 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:50.958942 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:50.959467 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.960084 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.960914 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:50.961194 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:50.961280 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:50.964153 (+ 2873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:44555: BlockingRecv error: recv got EOF from 127.19.77.130:44555 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 05 22:37:51 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:51 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:51.097440 29158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:51.091541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:40583)
0805 22:37:51.091743 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:51.091755 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:51.091862 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:51.092049 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:51.092050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:51.092265 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:51.092314 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:51.092316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.093015 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.093016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:51.093545 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:51.093546 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.093920 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.093921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:51.093975 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:51.094606 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:51.094612 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:51.097307 (+ 2695us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":87,"threads_started":1}
W20260805 22:37:51.097462 29156 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:51.091591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:40583 (local address 127.19.77.190:43495)
0805 22:37:51.091716 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:51.091719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:51.091837 (+ 118us) server_negotiation.cc:407] Connection header received
0805 22:37:51.091954 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:51.091955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:51.091972 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:51.092032 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:51.092404 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.092916 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.093650 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.093846 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.093922 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:51.097410 (+ 3488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:40583: BlockingRecv error: recv got EOF from 127.19.77.131:40583 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 05 22:37:51 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:51 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:51.834725 29159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:51.829827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:47867)
0805 22:37:51.829996 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:51.830008 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:51.830068 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:51.830321 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:51.830323 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:51.830504 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:51.830565 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:51.830567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.831320 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.831321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:51.831869 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:51.831871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.832239 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.832240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:51.832284 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:51.832769 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:51.832774 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:51.834662 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":102,"threads_started":1}
W20260805 22:37:51.834906 29160 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:51.829920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:47867 (local address 127.19.77.190:43495)
0805 22:37:51.830064 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:51.830066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:51.830085 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:37:51.830109 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:51.830109 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:51.830121 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:51.830193 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:51.830651 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.831234 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.831967 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.832163 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.832219 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:51.834825 (+ 2606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:47867: BlockingRecv error: recv got EOF from 127.19.77.129:47867 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
Aug 05 22:37:51 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:51 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:51.969937 29161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:51.964651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:41081)
0805 22:37:51.964891 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:51.964904 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:51.965004 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:51.965188 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:51.965189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:51.965386 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:51.965435 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:51.965437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.966138 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.966139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:51.966665 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:51.966667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.967029 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.967030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:51.967094 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:51.967662 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:51.967667 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:51.969875 (+ 2208us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":112,"threads_started":1}
W20260805 22:37:51.970213 29160 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:51.964758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:41081 (local address 127.19.77.190:43495)
0805 22:37:51.964883 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:51.964885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:51.964982 (+ 97us) server_negotiation.cc:407] Connection header received
0805 22:37:51.965085 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:51.965086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:51.965099 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:51.965182 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:51.965524 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.966043 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.966751 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:51.966942 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:51.967023 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:51.970149 (+ 3126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:41081: BlockingRecv error: recv got EOF from 127.19.77.130:41081 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 05 22:37:52 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:52 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:52.103060 29162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:52.098059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:34827)
0805 22:37:52.098240 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:52.098257 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:52.098324 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:52.098467 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:52.098467 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:52.098644 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:52.098696 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:52.098698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.099504 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.099505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:52.100079 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:52.100081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.100471 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.100473 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:52.100525 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:52.101030 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:52.101035 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:52.102960 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":69,"threads_started":1}
W20260805 22:37:52.103134 29160 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:52.098266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:34827 (local address 127.19.77.190:43495)
0805 22:37:52.098338 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:52.098340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:52.098352 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:37:52.098396 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:52.098397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:52.098408 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:52.098460 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:52.098793 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.099365 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.100177 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.100365 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.100427 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:52.103060 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:34827: BlockingRecv error: recv got EOF from 127.19.77.131:34827 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 05 22:37:52 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:52 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:52.840844 29164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:52.835265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:37147)
0805 22:37:52.835477 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:52.835489 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:52.835556 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:52.835694 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:52.835695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:52.835875 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:52.835928 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:52.835929 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.836619 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.836620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:52.837182 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:52.837183 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.837582 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.837583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:52.837637 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:52.838177 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:52.838182 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:52.840780 (+ 2598us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":117,"threads_started":1}
W20260805 22:37:52.841053 29165 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:52.835366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:37147 (local address 127.19.77.190:43495)
0805 22:37:52.835482 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:52.835484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:52.835554 (+ 70us) server_negotiation.cc:407] Connection header received
0805 22:37:52.835601 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:52.835602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:52.835612 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:52.835670 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:52.836015 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.836538 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.837276 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.837484 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.837552 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:52.840926 (+ 3374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:37147: BlockingRecv error: recv got EOF from 127.19.77.129:37147 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":65,"threads_started":1}
Aug 05 22:37:52 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:52 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:52.975479 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:52.970576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:48321)
0805 22:37:52.970719 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:52.970736 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:52.970788 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:52.970928 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:52.970929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:52.971123 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:52.971209 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:52.971211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.971917 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.971918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:52.972481 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:52.972483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.972839 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.972840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:52.972887 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:52.973460 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:52.973465 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:52.975412 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":86,"threads_started":1}
W20260805 22:37:52.975625 29165 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:52.970699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:48321 (local address 127.19.77.190:43495)
0805 22:37:52.970773 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:52.970775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:52.970785 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:52.970854 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:52.970854 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:52.970865 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:52.970910 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:52.971285 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.971831 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.972571 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:52.972763 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:52.972813 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:52.975541 (+ 2728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:48321: BlockingRecv error: recv got EOF from 127.19.77.130:48321 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 05 22:37:53 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:53 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:53.108522 29167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:53.103653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:38841)
0805 22:37:53.103852 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:53.103866 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:53.103942 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:53.104093 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:53.104093 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:53.104283 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:53.104334 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:53.104336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.105103 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.105104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:53.105632 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:53.105634 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.105983 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.105984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:53.106050 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:53.106529 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:53.106535 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:53.108416 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":117,"threads_started":1}
W20260805 22:37:53.108587 29165 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:53.103765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:38841 (local address 127.19.77.190:43495)
0805 22:37:53.103838 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:53.103841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:53.103920 (+ 79us) server_negotiation.cc:407] Connection header received
0805 22:37:53.103998 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:53.103999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:53.104013 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:53.104080 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:53.104419 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.104994 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.105719 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.105908 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.105985 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:53.108521 (+ 2536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:38841: BlockingRecv error: recv got EOF from 127.19.77.131:38841 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 05 22:37:53 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:53 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:53.850131 29168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:53.841557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:56681)
0805 22:37:53.841735 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:53.841755 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:53.841810 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:53.842068 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:53.842070 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:53.842261 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:53.842314 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:53.842316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.842984 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.842985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:53.843568 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:53.843569 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.843933 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.843934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:53.843986 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:53.848138 (+ 4152us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:53.848144 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:53.850061 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":120,"threads_started":1}
W20260805 22:37:53.850335 29169 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:53.841678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:56681 (local address 127.19.77.190:43495)
0805 22:37:53.841828 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:53.841830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:53.841840 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:37:53.841866 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:53.841867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:53.841877 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:53.841966 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:53.842404 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.842909 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.843640 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.843833 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.843905 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:53.850256 (+ 6351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:56681: BlockingRecv error: recv got EOF from 127.19.77.129:56681 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
Aug 05 22:37:53 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:53 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:53.981185 29170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:53.976127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:53725)
0805 22:37:53.976293 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:53.976304 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:53.976370 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:53.976521 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:53.976522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:53.976702 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:53.976769 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:53.976771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.977466 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.977467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:53.977994 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:53.977995 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.978345 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.978346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:53.978390 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:53.979030 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:53.979035 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:53.981074 (+ 2039us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
W20260805 22:37:53.981237 29169 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:53.976230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:53725 (local address 127.19.77.190:43495)
0805 22:37:53.976304 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:53.976306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:53.976371 (+ 65us) server_negotiation.cc:407] Connection header received
0805 22:37:53.976416 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:53.976417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:53.976428 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:53.976501 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:53.976878 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.977385 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.978082 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:53.978274 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:53.978331 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:53.981169 (+ 2838us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:53725: BlockingRecv error: recv got EOF from 127.19.77.130:53725 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 05 22:37:54 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:54 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:54.115016 29171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:54.109133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:57021)
0805 22:37:54.109316 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:54.109332 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:54.109394 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:54.109607 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:54.109609 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:54.109802 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:54.109857 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:54.109859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.110959 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.110960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:54.111643 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:54.111645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.112153 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.112154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:54.112208 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:54.112874 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:54.112880 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:54.114938 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":108,"threads_started":1}
W20260805 22:37:54.115198 29169 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:54.109336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:57021 (local address 127.19.77.190:43495)
0805 22:37:54.109407 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:54.109409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:54.109461 (+ 52us) server_negotiation.cc:407] Connection header received
0805 22:37:54.109488 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:54.109489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:54.109501 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:54.109551 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:54.110076 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.110812 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.111787 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.112053 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.112136 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:54.115075 (+ 2939us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:57021: BlockingRecv error: recv got EOF from 127.19.77.131:57021 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 05 22:37:54 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:54 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:54.855582 29172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:54.850640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:50751)
0805 22:37:54.850798 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:54.850818 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:54.850869 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:54.851035 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:54.851036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:54.851250 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:54.851301 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:54.851303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.852018 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.852019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:54.852594 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:54.852596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.852961 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.852961 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:54.853004 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:54.853505 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:54.853509 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:54.855481 (+ 1972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
W20260805 22:37:54.855659 29173 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:54.850763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:50751 (local address 127.19.77.190:43495)
0805 22:37:54.850906 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:54.850907 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:54.850916 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:54.850937 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:54.850938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:54.850948 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:54.851019 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:54.851380 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.851934 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.852683 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.852888 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.852946 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:54.855584 (+ 2638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:50751: BlockingRecv error: recv got EOF from 127.19.77.129:50751 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
Aug 05 22:37:54 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:54 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:54.987725 29174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:54.981883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:50823)
0805 22:37:54.982107 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:54.982121 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:54.982196 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:54.982355 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:54.982355 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:54.982536 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:54.982590 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:54.982591 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.983373 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.983375 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:54.984103 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:54.984106 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.984708 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.984710 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:54.984816 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:54.985509 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:54.985515 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:54.987656 (+ 2141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":101,"threads_started":1}
W20260805 22:37:54.987936 29173 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:54.982166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:50823 (local address 127.19.77.190:43495)
0805 22:37:54.982240 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:54.982243 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:54.982252 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:54.982283 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:54.982284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:54.982296 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:54.982347 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:54.982656 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.983191 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.984315 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:54.984564 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:54.984639 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:54.987878 (+ 3239us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:50823: BlockingRecv error: recv got EOF from 127.19.77.130:50823 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 05 22:37:55 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:55 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:55.120438 29175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:55.115757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:57193)
0805 22:37:55.115949 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:55.115960 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:55.116024 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:55.116198 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:55.116199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:55.116427 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:55.116478 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:55.116480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.117110 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.117111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:55.117638 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:55.117639 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.117969 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.117969 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:55.118009 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:55.118489 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:55.118493 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:55.120377 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":125,"threads_started":1}
W20260805 22:37:55.120635 29173 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:55.115856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:57193 (local address 127.19.77.190:43495)
0805 22:37:55.115961 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:55.115962 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:55.116005 (+ 43us) server_negotiation.cc:407] Connection header received
0805 22:37:55.116096 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:55.116097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:55.116112 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:55.116171 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:55.116533 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.117033 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.117718 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.117901 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.117957 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:55.120572 (+ 2615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:57193: BlockingRecv error: recv got EOF from 127.19.77.131:57193 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 05 22:37:55 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:55 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:55.862528 29176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:55.856149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:59787)
0805 22:37:55.856305 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:55.856318 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:55.856384 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:55.856538 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:55.856539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:55.856728 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:55.856781 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:55.856783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.857648 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.857649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:55.858207 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:55.858209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.858881 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.858882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:55.858946 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:55.859655 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:55.859661 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:55.862414 (+ 2753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
W20260805 22:37:55.862715 29177 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:55.856240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:59787 (local address 127.19.77.190:43495)
0805 22:37:55.856391 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:55.856393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:55.856405 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:37:55.856439 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:55.856440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:55.856450 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:55.856521 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:55.856860 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.857427 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.858380 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.858762 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.858848 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:55.862565 (+ 3717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:59787: BlockingRecv error: recv got EOF from 127.19.77.129:59787 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
Aug 05 22:37:55 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:55 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:55.994289 29178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:55.988595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:33057)
0805 22:37:55.988794 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:55.988811 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:55.988911 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:55.989177 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:55.989179 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:55.989376 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:55.989434 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:55.989436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.990266 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.990267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:55.990823 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:55.990825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.991276 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.991277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:55.991322 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:55.991865 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:55.991873 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:55.994224 (+ 2351us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":115,"threads_started":1}
W20260805 22:37:55.994508 29177 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:55.988721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:33057 (local address 127.19.77.190:43495)
0805 22:37:55.988826 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:55.988828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:55.988910 (+ 82us) server_negotiation.cc:407] Connection header received
0805 22:37:55.988981 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:55.988981 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:55.988996 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:55.989090 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:55.989535 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.990047 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.990941 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:55.991180 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:55.991243 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:55.994445 (+ 3202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:33057: BlockingRecv error: recv got EOF from 127.19.77.130:33057 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 05 22:37:56 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:56 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:56.125905 29179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:56.121063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:41591)
0805 22:37:56.121227 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:56.121244 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:56.121311 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:56.121476 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:56.121477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:56.121670 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:56.121722 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:56.121724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.122466 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.122468 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:56.122985 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:56.122986 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.123424 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.123425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:56.123492 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:56.124009 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:56.124014 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:56.125803 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":106,"threads_started":1}
W20260805 22:37:56.125959 29177 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:56.121273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:41591 (local address 127.19.77.190:43495)
0805 22:37:56.121350 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:56.121352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:56.121361 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:37:56.121386 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:56.121386 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:56.121399 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:56.121469 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:56.121813 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.122369 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.123077 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.123354 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.123425 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:56.125894 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:41591: BlockingRecv error: recv got EOF from 127.19.77.131:41591 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 05 22:37:56 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:56 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:56.868146 29180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:56.863114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:48171)
0805 22:37:56.863302 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:56.863312 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:56.863369 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:56.863569 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:56.863570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:56.863740 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:56.863793 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:56.863794 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.864496 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.864497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:56.865022 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:56.865023 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.865429 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.865430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:56.865479 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:56.865942 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:56.865947 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:56.868042 (+ 2095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":131,"threads_started":1}
W20260805 22:37:56.868223 29181 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:56.863257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:48171 (local address 127.19.77.190:43495)
0805 22:37:56.863417 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:56.863419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:56.863430 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:56.863465 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:56.863465 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:56.863475 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:56.863545 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:56.863852 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.864409 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.865148 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.865350 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.865411 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:56.868128 (+ 2717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:48171: BlockingRecv error: recv got EOF from 127.19.77.129:48171 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
Aug 05 22:37:56 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:56 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:56.999881 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:56.994851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:40277)
0805 22:37:56.995021 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:56.995032 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:56.995102 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:56.995301 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:56.995302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:56.995580 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:56.995639 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:56.995642 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.996320 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.996321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:56.996844 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:56.996845 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.997173 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.997174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:56.997215 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:56.997668 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:56.997673 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:56.999777 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":111,"threads_started":1}
W20260805 22:37:56.999948 29181 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:56.994920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:40277 (local address 127.19.77.190:43495)
0805 22:37:56.995010 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:56.995012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:56.995097 (+ 85us) server_negotiation.cc:407] Connection header received
0805 22:37:56.995196 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:56.995197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:56.995216 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:56.995281 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:56.995733 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.996250 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.996927 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:56.997108 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:56.997170 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:56.999885 (+ 2715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:40277: BlockingRecv error: recv got EOF from 127.19.77.130:40277 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 05 22:37:57 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:57 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:57.131312 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:57.126539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:45135)
0805 22:37:57.126701 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:57.126717 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:57.126785 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:57.126934 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:57.126934 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:57.127100 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:57.127187 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:57.127189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:57.127868 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:57.127869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:57.128393 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:57.128394 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:57.128741 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:57.128742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:57.128782 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:57.129236 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:57.129240 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:57.131208 (+ 1968us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":95,"threads_started":1}
W20260805 22:37:57.131464 29181 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:57.126640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:45135 (local address 127.19.77.190:43495)
0805 22:37:57.126718 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:57.126719 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:57.126770 (+ 51us) server_negotiation.cc:407] Connection header received
0805 22:37:57.126856 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:57.126857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:57.126869 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:57.126913 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:57.127262 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:57.127789 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:57.128481 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:57.128674 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:57.128732 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:57.131312 (+ 2580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:45135: BlockingRecv error: recv got EOF from 127.19.77.131:45135 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 05 22:37:57 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:57 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:57.874401 29184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:57.868793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:38055)
0805 22:37:57.869028 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:57.869045 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:57.869107 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:57.869244 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:57.869245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:57.869412 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:57.869468 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:57.869469 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:57.870132 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:57.870133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:57.870669 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:57.870670 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:57.871014 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:57.871014 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:57.871055 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:57.871593 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:57.871598 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:57.874317 (+ 2719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":138,"threads_started":1}
W20260805 22:37:57.874594 29185 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:57.868965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:38055 (local address 127.19.77.190:43495)
0805 22:37:57.869117 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:57.869119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:57.869127 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:37:57.869151 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:57.869152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:57.869162 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:57.869222 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:57.869544 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:57.870058 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:57.870747 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:57.870937 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:57.870992 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:57.874481 (+ 3489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:38055: BlockingRecv error: recv got EOF from 127.19.77.129:38055 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
Aug 05 22:37:57 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:57 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:58.006096 29186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:58.000675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:55265)
0805 22:37:58.001030 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:58.001050 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:58.001179 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:58.001357 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:58.001358 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:58.001576 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:58.001628 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:58.001630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.002479 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.002480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:58.003005 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:58.003006 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.003443 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.003445 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:58.003508 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:58.004077 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:58.004082 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:58.005990 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":146,"threads_started":1}
W20260805 22:37:58.006148 29185 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:58.000893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:55265 (local address 127.19.77.190:43495)
0805 22:37:58.001036 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:58.001040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:58.001152 (+ 112us) server_negotiation.cc:407] Connection header received
0805 22:37:58.001253 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:58.001255 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:58.001271 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:58.001349 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:58.001711 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.002388 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.003094 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.003359 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.003435 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:58.006079 (+ 2644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:55265: BlockingRecv error: recv got EOF from 127.19.77.130:55265 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 05 22:37:58 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:58 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:58.137555 29187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:58.131885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:52075)
0805 22:37:58.132122 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:58.132134 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:58.132227 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:58.132384 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:58.132385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:58.132580 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:58.132631 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:58.132633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.133322 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.133323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:58.133837 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:58.133839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.134186 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.134186 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:58.134245 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:58.134762 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:58.134767 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:58.137444 (+ 2677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":112,"threads_started":1}
W20260805 22:37:58.137681 29185 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:58.132006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:52075 (local address 127.19.77.190:43495)
0805 22:37:58.132089 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:58.132091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:58.132207 (+ 116us) server_negotiation.cc:407] Connection header received
0805 22:37:58.132287 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:58.132288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:58.132303 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:58.132376 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:58.132712 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.133228 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.133918 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.134113 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.134186 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:58.137601 (+ 3415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:52075: BlockingRecv error: recv got EOF from 127.19.77.131:52075 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 05 22:37:58 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:58 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:58.884260 29188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:58.875024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:58937)
0805 22:37:58.875550 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:58.875572 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:58.875668 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:58.875864 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:58.875866 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:58.876052 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:58.876108 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:58.876110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.876876 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.876878 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:58.877599 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:58.877603 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.878005 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.878006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:58.878050 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:58.881772 (+ 3722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:58.881780 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:58.884181 (+ 2401us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":244,"threads_started":1}
W20260805 22:37:58.884457 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:58.875310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:58937 (local address 127.19.77.190:43495)
0805 22:37:58.875582 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:58.875584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:58.875657 (+ 73us) server_negotiation.cc:407] Connection header received
0805 22:37:58.875739 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:58.875739 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:58.875752 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:58.875823 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:58.876194 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.876722 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.877710 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:58.877922 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:58.877989 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:58.884363 (+ 6374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:58937: BlockingRecv error: recv got EOF from 127.19.77.129:58937 (error 108)
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":263,"threads_started":1}
Aug 05 22:37:59 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:59 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:59.011757 29190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:59.006702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:57725)
0805 22:37:59.006840 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:59.006858 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:59.006922 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:59.007095 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:59.007097 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:59.007337 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:59.007390 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:59.007392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.008125 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.008126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:59.008674 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:59.008675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.009036 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.009037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:59.009092 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:59.009663 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:59.009668 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:59.011696 (+ 2028us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
W20260805 22:37:59.011896 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:59.006797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:57725 (local address 127.19.77.190:43495)
0805 22:37:59.006906 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:59.006908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:59.006919 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:37:59.006984 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:59.006984 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:59.006997 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:59.007048 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:59.007523 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.008028 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.008761 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.008948 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.009006 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:59.011809 (+ 2803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:57725: BlockingRecv error: recv got EOF from 127.19.77.130:57725 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 05 22:37:59 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:59 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:59.143767 29191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:59.138230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:38575)
0805 22:37:59.138448 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:59.138461 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:59.138532 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:59.138674 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:59.138675 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:59.138876 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:59.138958 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:59.138960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.139693 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.139694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:59.140267 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:59.140269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.140691 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.140693 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:59.140742 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:59.141384 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:59.141392 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:59.143701 (+ 2309us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":122,"threads_started":1}
W20260805 22:37:59.143949 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:59.138331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:38575 (local address 127.19.77.190:43495)
0805 22:37:59.138412 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:59.138414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:59.138523 (+ 109us) server_negotiation.cc:407] Connection header received
0805 22:37:59.138584 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:59.138584 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:59.138597 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:59.138653 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:59.139041 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.139612 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.140358 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.140545 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.140634 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:59.143863 (+ 3229us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:38575: BlockingRecv error: recv got EOF from 127.19.77.131:38575 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 05 22:37:59 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:37:59 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:37:59.889976 29192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:37:59.884909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:60387)
0805 22:37:59.885204 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0805 22:37:59.885216 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:37:59.885298 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:37:59.885517 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:37:59.885518 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:37:59.885756 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:37:59.885825 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:59.885828 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.886549 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.886550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:59.887112 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:37:59.887114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.887533 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.887534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:37:59.887584 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:59.888106 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:37:59.888110 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:37:59.889914 (+ 1804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":109,"threads_started":1}
W20260805 22:37:59.890165 29193 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:37:59.885058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:60387 (local address 127.19.77.190:43495)
0805 22:37:59.885182 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0805 22:37:59.885185 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:37:59.885297 (+ 112us) server_negotiation.cc:407] Connection header received
0805 22:37:59.885377 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:37:59.885378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:37:59.885390 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:37:59.885481 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:37:59.885908 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.886446 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.887221 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:37:59.887443 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:37:59.887506 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:37:59.890082 (+ 2576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:60387: BlockingRecv error: recv got EOF from 127.19.77.129:60387 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
Aug 05 22:38:00 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:00 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:00.018079 29194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:00.012354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:39877)
0805 22:38:00.012501 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:00.012512 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:00.012573 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:00.012738 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:00.012738 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:00.012915 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:00.012968 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:00.012970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.013891 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.013892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:00.014458 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:00.014460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.014992 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.014994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:00.015072 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:00.015859 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:00.015864 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:00.017955 (+ 2091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
W20260805 22:38:00.018107 29193 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:00.012461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:39877 (local address 127.19.77.190:43495)
0805 22:38:00.012520 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:00.012522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:00.012560 (+ 38us) server_negotiation.cc:407] Connection header received
0805 22:38:00.012647 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:00.012648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:00.012671 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:00.012716 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:00.013138 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.013783 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.014553 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.014846 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.014926 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:00.018048 (+ 3122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:39877: BlockingRecv error: recv got EOF from 127.19.77.130:39877 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 05 22:38:00 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:00 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:00.149845 29195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:00.144331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:35887)
0805 22:38:00.144571 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:00.144582 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:00.144650 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:00.144864 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:00.144867 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:00.145103 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:00.145180 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:00.145182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.146070 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.146071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:00.146682 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:00.146683 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.147136 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.147198 (+ 62us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:00.147266 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:00.147776 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:00.147781 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:00.149743 (+ 1962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":126,"threads_started":1}
W20260805 22:38:00.149904 29193 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:00.144508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:35887 (local address 127.19.77.190:43495)
0805 22:38:00.144585 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:00.144587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:00.144652 (+ 65us) server_negotiation.cc:407] Connection header received
0805 22:38:00.144706 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:00.144707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:00.144720 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:00.144761 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:00.145368 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.145938 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.146807 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.147044 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.147129 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:00.149839 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:35887: BlockingRecv error: recv got EOF from 127.19.77.131:35887 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 05 22:38:00 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:00 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:00.896947 29196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:00.890532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:42207)
0805 22:38:00.890672 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:00.890688 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:00.890749 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:00.890945 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:00.890946 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:00.891129 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:00.891239 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:00.891241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.891967 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.891968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:00.892524 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:00.892525 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.892992 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.892994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:00.893085 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:00.893849 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:00.893855 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:00.896797 (+ 2942us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
W20260805 22:38:00.897032 29197 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:00.890673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:42207 (local address 127.19.77.190:43495)
0805 22:38:00.890808 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:00.890810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:00.890819 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:38:00.890845 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:00.890846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:00.890856 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:00.890932 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:00.891306 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.891823 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.892619 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:00.892838 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:00.892899 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:00.896939 (+ 4040us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:42207: BlockingRecv error: recv got EOF from 127.19.77.129:42207 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
Aug 05 22:38:01 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:01 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:01.024926 29198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:01.019253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:46847)
0805 22:38:01.019517 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:01.019531 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:01.019617 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:01.019793 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:01.019794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:01.020003 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:01.020051 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:01.020053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.020825 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.020827 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:01.021533 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:01.021535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.021898 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.021899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:01.021962 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:01.022646 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:01.022651 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:01.024827 (+ 2176us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":129,"threads_started":1}
W20260805 22:38:01.025032 29197 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:01.019280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:46847 (local address 127.19.77.190:43495)
0805 22:38:01.019376 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:01.019379 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:01.019600 (+ 221us) server_negotiation.cc:407] Connection header received
0805 22:38:01.019694 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:01.019695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:01.019708 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:01.019773 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:01.020135 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.020744 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.021612 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.021825 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.021899 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:01.024948 (+ 3049us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:46847: BlockingRecv error: recv got EOF from 127.19.77.130:46847 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 05 22:38:01 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:01 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:01.156462 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:01.150553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:34969)
0805 22:38:01.150780 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:01.150795 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:01.150911 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:01.151097 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:01.151098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:01.151376 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:01.151439 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:01.151441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.152155 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.152156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:01.152674 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:01.152675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.153016 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.153017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:01.153056 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:01.153739 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:01.153744 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:01.156337 (+ 2593us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":125,"threads_started":1}
W20260805 22:38:01.156504 29197 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:01.150688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:34969 (local address 127.19.77.190:43495)
0805 22:38:01.150787 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:01.150790 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:01.150885 (+ 95us) server_negotiation.cc:407] Connection header received
0805 22:38:01.150984 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:01.150985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:01.151002 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:01.151056 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:01.151525 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.152065 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.152761 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.152946 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.153004 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:01.156436 (+ 3432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:34969: BlockingRecv error: recv got EOF from 127.19.77.131:34969 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 05 22:38:01 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:01 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:01.903239 29200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:01.897654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:48809)
0805 22:38:01.897835 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:01.897861 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:01.897942 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:01.898139 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:01.898141 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:01.898362 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:01.898416 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:01.898418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.899092 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.899093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:01.899661 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:01.899662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.900027 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.900028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:01.900078 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:01.900675 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:01.900683 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:01.903124 (+ 2441us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":116,"threads_started":1}
W20260805 22:38:01.903410 29201 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:01.897726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:48809 (local address 127.19.77.190:43495)
0805 22:38:01.897862 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:01.897865 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:01.897991 (+ 126us) server_negotiation.cc:407] Connection header received
0805 22:38:01.898015 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:01.898016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:01.898027 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:01.898120 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:01.898483 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.899002 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.899736 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:01.899944 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:01.900000 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:01.903312 (+ 3312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:48809: BlockingRecv error: recv got EOF from 127.19.77.129:48809 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":67,"threads_started":1}
Aug 05 22:38:02 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:02 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:02.030529 29202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:02.025579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:47121)
0805 22:38:02.025720 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:02.025747 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:02.025825 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:02.025987 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:02.025988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:02.026183 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:02.026230 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:02.026232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.026889 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.026890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:02.027468 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:02.027470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.027817 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.027818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:02.027872 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:02.028357 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:02.028361 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:02.030412 (+ 2051us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
W20260805 22:38:02.030587 29201 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:02.025708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:47121 (local address 127.19.77.190:43495)
0805 22:38:02.025774 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:02.025776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:02.025804 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:38:02.025900 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:02.025901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:02.025914 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:02.025981 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:02.026306 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.026809 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.027551 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.027747 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.027820 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:02.030520 (+ 2700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:47121: BlockingRecv error: recv got EOF from 127.19.77.130:47121 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 05 22:38:02 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:02 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:02.163084 29203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:02.157275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:37461)
0805 22:38:02.157605 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:02.157624 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:02.157756 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:02.157942 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:02.157943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:02.158178 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:02.158226 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:02.158229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.158912 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.158913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:02.159573 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:02.159575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.159970 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.159971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:02.160024 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:02.160566 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:02.160571 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:02.162994 (+ 2423us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":184,"threads_started":1}
W20260805 22:38:02.163390 29201 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:02.157405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:37461 (local address 127.19.77.190:43495)
0805 22:38:02.157612 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:02.157615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:02.157732 (+ 117us) server_negotiation.cc:407] Connection header received
0805 22:38:02.157846 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:02.157847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:02.157862 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:02.157933 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:02.158311 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.158827 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.159655 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.159850 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.159968 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:02.163328 (+ 3360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:37461: BlockingRecv error: recv got EOF from 127.19.77.131:37461 (error 108)
Metrics: {"server-negotiator.queue_time_us":170}
Aug 05 22:38:02 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:02 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:02.909292 29204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:02.903882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:46137)
0805 22:38:02.904128 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:02.904141 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:02.904206 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:02.904343 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:02.904344 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:02.904525 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:02.904591 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:02.904592 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.905622 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.905623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:02.906330 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:02.906332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.906750 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.906752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:02.906803 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:02.907353 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:02.907358 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:02.909229 (+ 1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":147,"threads_started":1}
W20260805 22:38:02.909466 29205 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:02.904016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:46137 (local address 127.19.77.190:43495)
0805 22:38:02.904184 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:02.904186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:02.904205 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:38:02.904271 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:02.904272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:02.904284 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:02.904331 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:02.904759 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.905368 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.906404 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:02.906642 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:02.906701 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:02.909384 (+ 2683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:46137: BlockingRecv error: recv got EOF from 127.19.77.129:46137 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":98,"threads_started":1}
Aug 05 22:38:03 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:03 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:03.036523 29206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:03.031255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:33425)
0805 22:38:03.031537 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:03.031552 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:03.031632 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:03.031857 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:03.031858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:03.032114 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:03.032165 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:03.032167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.033018 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.033019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:03.033544 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:03.033545 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.033932 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.033933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:03.033988 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:03.034524 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:03.034529 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:03.036419 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":81,"threads_started":1}
W20260805 22:38:03.036581 29205 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:03.031537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:33425 (local address 127.19.77.190:43495)
0805 22:38:03.031642 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:03.031644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:03.031654 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:38:03.031689 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:03.031690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:03.031702 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:03.031762 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:03.032264 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.032943 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.033650 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.033858 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.033933 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:03.036511 (+ 2578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:33425: BlockingRecv error: recv got EOF from 127.19.77.130:33425 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 05 22:38:03 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:03 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:03.169260 29207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:03.163917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:53101)
0805 22:38:03.164132 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:03.164144 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:03.164247 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:03.164538 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:03.164539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:03.164738 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:03.164794 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:03.164795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.165752 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.165753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:03.166312 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:03.166314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.166769 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.166769 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:03.166814 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:03.167346 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:03.167351 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:03.169193 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":144,"threads_started":1}
W20260805 22:38:03.169404 29205 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:03.164220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:53101 (local address 127.19.77.190:43495)
0805 22:38:03.164331 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:03.164333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:03.164348 (+ 15us) server_negotiation.cc:407] Connection header received
0805 22:38:03.164380 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:03.164381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:03.164399 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:03.164471 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:03.164930 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.165612 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.166449 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.166686 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.166759 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:03.169318 (+ 2559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:53101: BlockingRecv error: recv got EOF from 127.19.77.131:53101 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 05 22:38:03 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:03 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:03.922356 29208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:03.909922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:35257)
0805 22:38:03.910116 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:03.910126 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:03.910191 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:03.910413 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:03.910414 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:03.910596 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:03.910681 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:03.910683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.911478 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.911479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:03.912032 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:03.912034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.912391 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.912391 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:03.912434 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:03.919443 (+ 7009us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:03.919454 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:03.922263 (+ 2809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":127,"threads_started":1}
W20260805 22:38:03.922665 29209 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:03.910067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:35257 (local address 127.19.77.190:43495)
0805 22:38:03.910233 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:03.910235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:03.910245 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:38:03.910273 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:03.910274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:03.910285 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:03.910365 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:03.910778 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.911386 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.912119 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:03.912318 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:03.912375 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:03.922558 (+ 10183us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:35257: BlockingRecv error: recv got EOF from 127.19.77.129:35257 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
Aug 05 22:38:04 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:04 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:04.043977 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:04.037265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:55899)
0805 22:38:04.037473 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:04.037495 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:04.037594 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:04.037798 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:04.037800 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:04.038028 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:04.038101 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:04.038103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.038937 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.038938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:04.039700 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:04.039703 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.040184 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.040185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:04.040246 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:04.040958 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:04.040964 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:04.043891 (+ 2927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":72,"threads_started":1}
W20260805 22:38:04.044104 29209 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:04.037485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:55899 (local address 127.19.77.190:43495)
0805 22:38:04.037570 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:04.037571 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:04.037586 (+ 15us) server_negotiation.cc:407] Connection header received
0805 22:38:04.037670 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:04.037671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:04.037684 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:04.037734 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:04.038236 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.038831 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.039832 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.040055 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.040133 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:04.044035 (+ 3902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:55899: BlockingRecv error: recv got EOF from 127.19.77.130:55899 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 05 22:38:04 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:04 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.131@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:04.175522 29211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:04.169818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.131:56507)
0805 22:38:04.169986 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:04.170002 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:04.170063 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:04.170273 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:04.170273 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:04.170452 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:04.170504 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:04.170506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.171331 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.171332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:04.171889 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:04.171892 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.172491 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.172491 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:04.172538 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:04.173113 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:04.173118 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:04.175451 (+ 2333us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":107,"threads_started":1}
W20260805 22:38:04.175740 29209 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:04.169930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:56507 (local address 127.19.77.190:43495)
0805 22:38:04.169999 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:04.170001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:04.170110 (+ 109us) server_negotiation.cc:407] Connection header received
0805 22:38:04.170139 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:04.170140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:04.170154 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:04.170224 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:04.170575 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.171165 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.172029 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.172366 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.172491 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:04.175677 (+ 3186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.131:56507: BlockingRecv error: recv got EOF from 127.19.77.131:56507 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 05 22:38:04 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:04 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.129@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:04.927829 29212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:04.923082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.129:48777)
0805 22:38:04.923299 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:04.923315 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:04.923401 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:04.923555 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:04.923556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:04.923726 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:04.923779 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:04.923780 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.924644 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.924645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:04.925187 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:04.925189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.925544 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.925545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:04.925584 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:04.926042 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:04.926047 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:04.927768 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":122,"threads_started":1}
W20260805 22:38:04.927954 29213 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:04.923207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:48777 (local address 127.19.77.190:43495)
0805 22:38:04.923340 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:04.923343 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:04.923412 (+ 69us) server_negotiation.cc:407] Connection header received
0805 22:38:04.923466 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:04.923467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:04.923478 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:04.923533 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:04.923899 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.924579 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.925265 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:04.925473 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:04.925527 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:04.927869 (+ 2342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.129:48777: BlockingRecv error: recv got EOF from 127.19.77.129:48777 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":52,"threads_started":1}
Aug 05 22:38:05 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:38:05 dist-test-slave-chsk krb5kdc[28139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.77.130@KRBTEST.COM for oryx/127.19.77.190@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:38:05.050638 29214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:05.044843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43495 (local address 127.19.77.130:42505)
0805 22:38:05.045148 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:05.045166 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:05.045289 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:05.045475 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:05.045476 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:05.045681 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:05.045735 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:05.045736 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.046506 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.046507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:05.047408 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:05.047411 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.047962 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.047963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:05.048018 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:05.048529 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:05.048534 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:05.050547 (+ 2013us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.77.190:43495: Server oryx/127.19.77.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":151,"threads_started":1}
W20260805 22:38:05.050789 29213 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:05.044999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:42505 (local address 127.19.77.190:43495)
0805 22:38:05.045131 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:05.045135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:05.045258 (+ 123us) server_negotiation.cc:407] Connection header received
0805 22:38:05.045375 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:05.045376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:05.045391 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:05.045463 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:05.045813 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.046344 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.047568 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.047829 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.047937 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:05.050695 (+ 2758us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.77.130:42505: BlockingRecv error: recv got EOF from 127.19.77.130:42505 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260805 22:38:05.080195 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 28730
I20260805 22:38:05.087455 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 28884
I20260805 22:38:05.093880 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 29020
I20260805 22:38:05.100229 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 28657
2026-08-05T22:38:05Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17683 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-05T22:38:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:38:05Z Disabled control of system clock
I20260805 22:38:05.133698 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43821
--webserver_interface=127.19.77.190
--webserver_port=0
--builtin_ntp_servers=127.19.77.148:32931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:43821
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260805 22:38:05.219602 29218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:05.219835 29218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:05.219857 29218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:05.221046 29218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:38:05.221094 29218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:05.221108 29218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:05.221122 29218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:38:05.221133 29218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:38:05.222536 29218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:32931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:43821
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:05.222772 29218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:05.223045 29218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:38:05.228857 29218 server_base.cc:1034] running on GCE node
W20260805 22:38:05.228899 29223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:05.228920 29226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:05.228929 29224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:05.229602 29218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:05.230083 29218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:05.231247 29218 hybrid_clock.cc:648] HybridClock initialized: now 1785969485231214 us; error 50 us; skew 500 ppm
I20260805 22:38:05.232731 29218 webserver.cc:460] Webserver started at http://127.19.77.190:44205/ using document root <none> and password file <none>
I20260805 22:38:05.233029 29218 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:05.233081 29218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:05.233229 29218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:05.234406 29218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "6a10544d9332721cb20aec5307f60820"
server_key_iv: "b71d4167fe6f7074c335c5bb2310722b"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.234798 29218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "6a10544d9332721cb20aec5307f60820"
server_key_iv: "b71d4167fe6f7074c335c5bb2310722b"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.236394 29218 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:38:05.237901 29232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.238132 29218 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:38:05.238242 29218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "6a10544d9332721cb20aec5307f60820"
server_key_iv: "b71d4167fe6f7074c335c5bb2310722b"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.238332 29218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:05.248443 29218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:05.248832 29218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:05.249002 29218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:05.253244 29218 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:43821
I20260805 22:38:05.253290 29284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:43821 every 8 connection(s)
I20260805 22:38:05.253666 29218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:38:05.254380 29285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:38:05.257206 29285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd: Bootstrap starting.
I20260805 22:38:05.257853 29285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd: Neither blocks nor log segments found. Creating new log.
I20260805 22:38:05.258185 29285 log.cc:824] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd: Log is configured to *not* fsync() on all Append() calls
I20260805 22:38:05.258935 29285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd: No bootstrap required, opened a new log
I20260805 22:38:05.259083 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 29218
I20260805 22:38:05.259209 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:38:05.259424 19766 external_mini_cluster.cc:1428] Setting key 403a7e67b91858369820c6792ddc220a
I20260805 22:38:05.261107 29285 raft_consensus.cc:348] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43821 } }
I20260805 22:38:05.261267 29285 raft_consensus.cc:374] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:38:05.261291 29285 raft_consensus.cc:729] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb98515bd6b4eecaf0dc653cdc0acdd, State: Initialized, Role: FOLLOWER
I20260805 22:38:05.261446 29285 consensus_queue.cc:260] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43821 } }
I20260805 22:38:05.261534 29285 raft_consensus.cc:388] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:38:05.261567 29285 raft_consensus.cc:482] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:38:05.261631 29285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:38:05.262243 29285 raft_consensus.cc:504] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43821 } }
I20260805 22:38:05.262373 29285 leader_election.cc:302] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ceb98515bd6b4eecaf0dc653cdc0acdd; no voters:
I20260805 22:38:05.262583 29285 leader_election.cc:288] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:38:05.262622 29290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:38:05.262741 29290 raft_consensus.cc:686] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [term 1 LEADER]: Becoming Leader. State: Replica: ceb98515bd6b4eecaf0dc653cdc0acdd, State: Running, Role: LEADER
I20260805 22:38:05.262882 29285 sys_catalog.cc:564] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:38:05.262890 29290 consensus_queue.cc:237] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43821 } }
I20260805 22:38:05.263873 29292 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43821 } } }
I20260805 22:38:05.263887 29291 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ceb98515bd6b4eecaf0dc653cdc0acdd. Latest consensus state: current_term: 1 leader_uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceb98515bd6b4eecaf0dc653cdc0acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43821 } } }
I20260805 22:38:05.263985 29292 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [sys.catalog]: This master's current role is: LEADER
I20260805 22:38:05.264001 29291 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd [sys.catalog]: This master's current role is: LEADER
I20260805 22:38:05.264456 29300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:38:05.265166 29300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:38:05.267283 29300 catalog_manager.cc:1347] Generated new cluster ID: a79f54e16b9c44dda3833bc9f3e40d76
I20260805 22:38:05.267343 29300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:38:05.267809 29289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:05.260031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42132 (local address 127.19.77.190:43821)
0805 22:38:05.260239 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:05.260246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:05.260272 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:38:05.261158 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:05.261174 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:05.261500 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:05.261779 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:05.262212 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.264380 (+ 2168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.265588 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.266131 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.266256 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:05.267022 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:05.267026 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:05.267026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:38:05.267258 (+ 232us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:05.267301 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:38:05.267316 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:05.267385 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:05.267519 (+ 134us) server_negotiation.cc:299] Negotiation successful
0805 22:38:05.267606 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":102,"threads_started":1}
I20260805 22:38:05.283226 29300 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:38:05.283795 29300 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:38:05.289541 29300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ceb98515bd6b4eecaf0dc653cdc0acdd: Generated new TSK 0
I20260805 22:38:05.289750 29300 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:38:05.296438 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43821
--builtin_ntp_servers=127.19.77.148:32931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260805 22:38:05.394654 29309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:05.394878 29309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:05.394903 29309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:05.396226 29309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:05.396277 29309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:05.396306 29309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:38:05.397779 29309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:32931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:05.398048 29309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:05.398383 29309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:05.403651 29316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:05.403617 29315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:05.403638 29318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:05.404675 29309 server_base.cc:1034] running on GCE node
I20260805 22:38:05.404915 29309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:05.405217 29309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:05.406404 29309 hybrid_clock.cc:648] HybridClock initialized: now 1785969485406383 us; error 33 us; skew 500 ppm
I20260805 22:38:05.408211 29309 webserver.cc:460] Webserver started at http://127.19.77.129:38693/ using document root <none> and password file <none>
I20260805 22:38:05.408506 29309 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:05.408583 29309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:05.408718 29309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:05.410228 29309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "3fa9c56b86374ad0b4dc5b13aebe6e78"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "a5a4c449cb5dc47a657fdbc076418f63"
server_key_iv: "9ebc0c18596446587493bb304dd406c6"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.410737 29309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "3fa9c56b86374ad0b4dc5b13aebe6e78"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "a5a4c449cb5dc47a657fdbc076418f63"
server_key_iv: "9ebc0c18596446587493bb304dd406c6"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.412703 29309 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260805 22:38:05.413626 29324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.413841 29309 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:38:05.413934 29309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "3fa9c56b86374ad0b4dc5b13aebe6e78"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "a5a4c449cb5dc47a657fdbc076418f63"
server_key_iv: "9ebc0c18596446587493bb304dd406c6"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.414006 29309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:05.434155 29309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:05.434469 29309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:05.434585 29309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:05.434830 29309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:38:05.435302 29309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:38:05.435364 29309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.435401 29309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:38:05.435433 29309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.443732 29309 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:34027
I20260805 22:38:05.443804 29438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:34027 every 8 connection(s)
I20260805 22:38:05.444334 29309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:38:05.453410 29289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:05.445227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:51973 (local address 127.19.77.190:43821)
0805 22:38:05.445282 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:05.445285 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:05.447561 (+ 2276us) server_negotiation.cc:407] Connection header received
0805 22:38:05.448387 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:05.448389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:05.448407 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:05.448482 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:05.449335 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.450135 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.451728 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.452020 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.452101 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:05.453097 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:05.453098 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:05.453099 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:38:05.453105 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:05.453122 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:38:05.453127 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:05.453201 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:05.453282 (+ 81us) server_negotiation.cc:299] Negotiation successful
0805 22:38:05.453319 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:38:05.453876 29441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:05.445164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43821 (local address 127.19.77.129:51973)
0805 22:38:05.447388 (+ 2224us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:05.447446 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:05.448269 (+ 823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:05.448580 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:05.448642 (+ 62us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:05.448655 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:05.449217 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:05.449223 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.450268 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.450269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:05.451628 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:05.451632 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.452121 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.452123 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:05.452295 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:05.452926 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:38:05.452927 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:05.452958 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:38:05.452984 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:38:05.453207 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:38:05.453214 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:38:05.453217 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:38:05.453288 (+ 71us) client_negotiation.cc:240] Negotiation successful
0805 22:38:05.453403 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2120,"thread_start_us":99,"threads_started":1}
I20260805 22:38:05.454442 29439 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43821
I20260805 22:38:05.454573 29439 heartbeater.cc:464] Registering TS with master...
I20260805 22:38:05.454594 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 29309
I20260805 22:38:05.454696 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:38:05.454828 29439 heartbeater.cc:511] Master 127.19.77.190:43821 requested a full tablet report, sending...
I20260805 22:38:05.454921 19766 external_mini_cluster.cc:1428] Setting key 8f8eee63e177ee504f55f1ea5c6ba549
I20260805 22:38:05.455438 29249 ts_manager.cc:194] Registered new tserver with Master: 3fa9c56b86374ad0b4dc5b13aebe6e78 (127.19.77.129:34027)
I20260805 22:38:05.456162 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43821
--builtin_ntp_servers=127.19.77.148:32931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260805 22:38:05.456314 29249 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.129:51973
W20260805 22:38:05.549659 29442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:05.549897 29442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:05.549923 29442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:05.551170 29442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:05.551221 29442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:05.551273 29442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:38:05.552753 29442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:32931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:05.553013 29442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:05.553360 29442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:05.558609 29449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:05.558656 29448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:05.558609 29451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:05.558825 29442 server_base.cc:1034] running on GCE node
I20260805 22:38:05.559053 29442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:05.559345 29442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:05.560513 29442 hybrid_clock.cc:648] HybridClock initialized: now 1785969485560487 us; error 41 us; skew 500 ppm
I20260805 22:38:05.561965 29442 webserver.cc:460] Webserver started at http://127.19.77.130:40257/ using document root <none> and password file <none>
I20260805 22:38:05.562223 29442 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:05.562275 29442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:05.562446 29442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:05.563714 29442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "2377c5cc65824d2dbda27c0be08de91e"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "1c95a7adc8629b5c05cb9eb127a594a9"
server_key_iv: "2c55354a273ab6f7141d58b180bc166b"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.564131 29442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "2377c5cc65824d2dbda27c0be08de91e"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "1c95a7adc8629b5c05cb9eb127a594a9"
server_key_iv: "2c55354a273ab6f7141d58b180bc166b"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.565574 29442 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:38:05.566368 29457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.566546 29442 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:38:05.566637 29442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "2377c5cc65824d2dbda27c0be08de91e"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "1c95a7adc8629b5c05cb9eb127a594a9"
server_key_iv: "2c55354a273ab6f7141d58b180bc166b"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.566716 29442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:05.582898 29442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:05.583323 29442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:05.583474 29442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:05.583735 29442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:38:05.584092 29442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:38:05.584144 29442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.584179 29442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:38:05.584206 29442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.591254 29442 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:45313
I20260805 22:38:05.591295 29574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:45313 every 8 connection(s)
I20260805 22:38:05.591660 29442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:38:05.593098 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 29442
I20260805 22:38:05.593174 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:38:05.593375 19766 external_mini_cluster.cc:1428] Setting key 36bf8d87e248b1762fe1b49b0d8fbe83
I20260805 22:38:05.594395 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43821
--builtin_ntp_servers=127.19.77.148:32931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260805 22:38:05.597414 29289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:05.592476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:44837 (local address 127.19.77.190:43821)
0805 22:38:05.592543 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:05.592550 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:05.592781 (+ 231us) server_negotiation.cc:407] Connection header received
0805 22:38:05.593377 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:05.593378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:05.593391 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:05.593445 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:05.594268 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.594878 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.595949 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.596154 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.596233 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:05.597125 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:05.597126 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:05.597127 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:38:05.597132 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:05.597148 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:38:05.597153 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:05.597203 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:05.597298 (+ 95us) server_negotiation.cc:299] Negotiation successful
0805 22:38:05.597329 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260805 22:38:05.597648 29577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:05.592463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43821 (local address 127.19.77.130:44837)
0805 22:38:05.592656 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:05.592691 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:05.593268 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:05.593528 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:05.593532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:05.593540 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:05.594178 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:05.594183 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.594980 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.594981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:05.595854 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:05.595857 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.596244 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.596245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:05.596383 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:05.596962 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:38:05.596963 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:05.596992 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:38:05.597015 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:38:05.597210 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:38:05.597215 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:38:05.597218 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:38:05.597300 (+ 82us) client_negotiation.cc:240] Negotiation successful
0805 22:38:05.597409 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
I20260805 22:38:05.598152 29575 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43821
I20260805 22:38:05.598263 29575 heartbeater.cc:464] Registering TS with master...
I20260805 22:38:05.598454 29575 heartbeater.cc:511] Master 127.19.77.190:43821 requested a full tablet report, sending...
I20260805 22:38:05.598892 29249 ts_manager.cc:194] Registered new tserver with Master: 2377c5cc65824d2dbda27c0be08de91e (127.19.77.130:45313)
I20260805 22:38:05.599483 29249 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.130:44837
W20260805 22:38:05.679622 29578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:05.679931 29578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:05.679957 29578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:05.681142 29578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:05.681188 29578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:05.681216 29578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:38:05.682557 29578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:32931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:05.682783 29578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:05.683072 29578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:05.688436 29584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:05.688464 29583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:05.688436 29586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:05.688875 29578 server_base.cc:1034] running on GCE node
I20260805 22:38:05.689110 29578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:05.689399 29578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:05.690551 29578 hybrid_clock.cc:648] HybridClock initialized: now 1785969485690527 us; error 51 us; skew 500 ppm
I20260805 22:38:05.691932 29578 webserver.cc:460] Webserver started at http://127.19.77.131:43327/ using document root <none> and password file <none>
I20260805 22:38:05.692210 29578 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:05.692260 29578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:05.692430 29578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:05.693560 29578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "ab0410c0e4264e74905a1f7cd74b802f"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "3e16ed4d8e7840cabc075aba07a07746"
server_key_iv: "381ac9328972dc481bb88db67ddec151"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.693953 29578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "ab0410c0e4264e74905a1f7cd74b802f"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "3e16ed4d8e7840cabc075aba07a07746"
server_key_iv: "381ac9328972dc481bb88db67ddec151"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.695454 29578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:38:05.696246 29592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.696424 29578 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:38:05.696514 29578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "ab0410c0e4264e74905a1f7cd74b802f"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "3e16ed4d8e7840cabc075aba07a07746"
server_key_iv: "381ac9328972dc481bb88db67ddec151"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.696590 29578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:05.705556 29578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:05.705893 29578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:05.706046 29578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:05.706291 29578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:38:05.706677 29578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:38:05.706727 29578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.706773 29578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:38:05.706802 29578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.713050 29578 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:44819
I20260805 22:38:05.713102 29707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:44819 every 8 connection(s)
I20260805 22:38:05.713452 29578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:38:05.719259 29289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:05.714174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:47943 (local address 127.19.77.190:43821)
0805 22:38:05.714221 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:05.714223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:05.714474 (+ 251us) server_negotiation.cc:407] Connection header received
0805 22:38:05.714964 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:05.714965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:05.714976 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:05.715042 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:05.715780 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.716285 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.717512 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.717733 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.717797 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:05.718897 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:05.718899 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:05.718899 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:38:05.718904 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:05.718920 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:38:05.718924 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:05.718978 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:05.719096 (+ 118us) server_negotiation.cc:299] Negotiation successful
0805 22:38:05.719126 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:38:05.719509 29711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:05.714145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43821 (local address 127.19.77.131:47943)
0805 22:38:05.714340 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:05.714383 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:05.714878 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:05.715117 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:05.715120 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:05.715188 (+ 68us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:05.715701 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:05.715706 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.716364 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.716365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:05.717168 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:05.717170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:05.717844 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:05.717846 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:05.718009 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:05.718702 (+ 693us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:38:05.718703 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:05.718741 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:38:05.718775 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:38:05.719006 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:38:05.719013 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:38:05.719016 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:38:05.719085 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:38:05.719270 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260805 22:38:05.720218 29709 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43821
I20260805 22:38:05.720427 29709 heartbeater.cc:464] Registering TS with master...
I20260805 22:38:05.720530 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 29578
I20260805 22:38:05.720628 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:38:05.720839 19766 external_mini_cluster.cc:1428] Setting key 143cc767a4526ae0962d70902d8a5d6c
I20260805 22:38:05.720841 29709 heartbeater.cc:511] Master 127.19.77.190:43821 requested a full tablet report, sending...
I20260805 22:38:05.721408 29249 ts_manager.cc:194] Registered new tserver with Master: ab0410c0e4264e74905a1f7cd74b802f (127.19.77.131:44819)
I20260805 22:38:05.721804 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:38:05.721915 29249 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.131:47943
W20260805 22:38:05.723788 29289 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:05.723309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42142 (local address 127.19.77.190:43821)
0805 22:38:05.723352 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:05.723354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:05.723495 (+ 141us) server_negotiation.cc:407] Connection header received
0805 22:38:05.723536 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:05.723536 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:05.723547 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:05.723611 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:05.723713 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42142: BlockingRecv error: recv got EOF from 127.0.0.1:42142 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:38:05.723869 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 29309
I20260805 22:38:05.730636 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 29442
I20260805 22:38:05.738026 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 29578
I20260805 22:38:05.744387 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 29218
2026-08-05T22:38:05Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (640 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-05T22:38:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:38:05Z Disabled control of system clock
I20260805 22:38:05.775380 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:38409
--webserver_interface=127.19.77.190
--webserver_port=0
--builtin_ntp_servers=127.19.77.148:37529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:38409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260805 22:38:05.863781 29720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:05.864013 29720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:05.864037 29720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:05.865284 29720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:38:05.865330 29720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:05.865343 29720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:05.865382 29720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:38:05.865410 29720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:38:05.866866 29720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:38409
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:38409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:05.867156 29720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:05.867472 29720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:05.872280 29725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:05.872284 29726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:05.872335 29728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:05.872509 29720 server_base.cc:1034] running on GCE node
I20260805 22:38:05.872789 29720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:05.873109 29720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:05.874281 29720 hybrid_clock.cc:648] HybridClock initialized: now 1785969485874272 us; error 36 us; skew 500 ppm
I20260805 22:38:05.875662 29720 webserver.cc:460] Webserver started at http://127.19.77.190:38309/ using document root <none> and password file <none>
I20260805 22:38:05.875933 29720 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:05.876004 29720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:05.876157 29720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:05.877261 29720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "9d0f19304576428693e272ea45804531"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "0873e604824c484156b7bb35d98310db"
server_key_iv: "21cf56de293bfa5335ab781c9cd691f3"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.877636 29720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "9d0f19304576428693e272ea45804531"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "0873e604824c484156b7bb35d98310db"
server_key_iv: "21cf56de293bfa5335ab781c9cd691f3"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.879045 29720 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:38:05.879801 29735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:05.880030 29720 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:38:05.880105 29720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "9d0f19304576428693e272ea45804531"
format_stamp: "Formatted at 2026-08-05 22:38:05 on dist-test-slave-chsk"
server_key: "0873e604824c484156b7bb35d98310db"
server_key_iv: "21cf56de293bfa5335ab781c9cd691f3"
server_key_version: "encryptionkey@0"
I20260805 22:38:05.880159 29720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:05.884892 29720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:05.885293 29720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:05.885459 29720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:05.891709 29720 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:38409
I20260805 22:38:05.891780 29787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:38409 every 8 connection(s)
I20260805 22:38:05.892174 29720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:38:05.893224 29788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:38:05.895684 29788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531: Bootstrap starting.
I20260805 22:38:05.896306 29788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531: Neither blocks nor log segments found. Creating new log.
I20260805 22:38:05.896612 29788 log.cc:824] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531: Log is configured to *not* fsync() on all Append() calls
I20260805 22:38:05.897388 29788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531: No bootstrap required, opened a new log
I20260805 22:38:05.899047 29788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0f19304576428693e272ea45804531" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38409 } }
I20260805 22:38:05.899293 29788 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:38:05.899340 29788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0f19304576428693e272ea45804531, State: Initialized, Role: FOLLOWER
I20260805 22:38:05.899504 29788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0f19304576428693e272ea45804531" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38409 } }
I20260805 22:38:05.899566 29788 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:38:05.899616 29788 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:38:05.899667 29788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:38:05.900312 29788 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0f19304576428693e272ea45804531" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38409 } }
I20260805 22:38:05.900408 29788 leader_election.cc:302] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d0f19304576428693e272ea45804531; no voters:
I20260805 22:38:05.900609 29788 leader_election.cc:288] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:38:05.900746 29791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:38:05.900931 29791 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [term 1 LEADER]: Becoming Leader. State: Replica: 9d0f19304576428693e272ea45804531, State: Running, Role: LEADER
I20260805 22:38:05.901031 29791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0f19304576428693e272ea45804531" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38409 } }
I20260805 22:38:05.901033 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 29720
I20260805 22:38:05.901142 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:38:05.901358 19766 external_mini_cluster.cc:1428] Setting key 2259cc2ea866626b7c9d911ff3a93af1
I20260805 22:38:05.901432 29793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d0f19304576428693e272ea45804531. Latest consensus state: current_term: 1 leader_uuid: "9d0f19304576428693e272ea45804531" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0f19304576428693e272ea45804531" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38409 } } }
I20260805 22:38:05.901535 29793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [sys.catalog]: This master's current role is: LEADER
I20260805 22:38:05.901811 29792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d0f19304576428693e272ea45804531" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0f19304576428693e272ea45804531" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38409 } } }
I20260805 22:38:05.901880 29792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [sys.catalog]: This master's current role is: LEADER
I20260805 22:38:05.902282 29788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:38:05.902326 29795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:38:05.902853 29795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:38:05.905364 29795 catalog_manager.cc:1347] Generated new cluster ID: 7f165bf2f19147b6b5845d596d04d230
I20260805 22:38:05.905440 29795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:38:05.906154 29798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:05.902077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56678 (local address 127.19.77.190:38409)
0805 22:38:05.902292 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:05.902301 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:05.903371 (+ 1070us) server_negotiation.cc:407] Connection header received
0805 22:38:05.903600 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:05.903609 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:05.903663 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:05.903784 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:05.905627 (+ 1843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:05.905632 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:05.905632 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:38:05.905639 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:05.905705 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:38:05.905720 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:05.905805 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:05.905879 (+ 74us) server_negotiation.cc:299] Negotiation successful
0805 22:38:05.905944 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":69,"threads_started":1}
I20260805 22:38:05.918015 29795 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:38:05.918255 29795 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:38:05.921777 29795 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d0f19304576428693e272ea45804531: Generated new TSK 0
I20260805 22:38:05.922006 29795 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:38:05.927372 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38409
--builtin_ntp_servers=127.19.77.148:37529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260805 22:38:06.017585 29812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:06.017856 29812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:06.017897 29812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:06.019191 29812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:06.019268 29812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:06.019313 29812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:38:06.020982 29812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:06.021342 29812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:06.021701 29812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:06.027087 29820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:06.027055 29817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:06.027047 29818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:06.027870 29812 server_base.cc:1034] running on GCE node
I20260805 22:38:06.028162 29812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:06.028467 29812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:06.029671 29812 hybrid_clock.cc:648] HybridClock initialized: now 1785969486029611 us; error 77 us; skew 500 ppm
I20260805 22:38:06.031224 29812 webserver.cc:460] Webserver started at http://127.19.77.129:44635/ using document root <none> and password file <none>
I20260805 22:38:06.031517 29812 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:06.031596 29812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:06.031764 29812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:06.032956 29812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "0015f2e20cfc45a8b452446a9f68618a"
format_stamp: "Formatted at 2026-08-05 22:38:06 on dist-test-slave-chsk"
server_key: "064c2984732a0be9aae0188d3ec96c2e"
server_key_iv: "6c3cc604249b7e00810efc0a6c1dffe7"
server_key_version: "encryptionkey@0"
I20260805 22:38:06.033346 29812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "0015f2e20cfc45a8b452446a9f68618a"
format_stamp: "Formatted at 2026-08-05 22:38:06 on dist-test-slave-chsk"
server_key: "064c2984732a0be9aae0188d3ec96c2e"
server_key_iv: "6c3cc604249b7e00810efc0a6c1dffe7"
server_key_version: "encryptionkey@0"
I20260805 22:38:06.034948 29812 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:38:06.035928 29826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:06.036144 29812 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:38:06.036281 29812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "0015f2e20cfc45a8b452446a9f68618a"
format_stamp: "Formatted at 2026-08-05 22:38:06 on dist-test-slave-chsk"
server_key: "064c2984732a0be9aae0188d3ec96c2e"
server_key_iv: "6c3cc604249b7e00810efc0a6c1dffe7"
server_key_version: "encryptionkey@0"
I20260805 22:38:06.036366 29812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:06.040028 29812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:06.040331 29812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:06.040485 29812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:06.040728 29812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:38:06.041055 29812 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:38:06.041115 29812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:06.041158 29812 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:38:06.041182 29812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:06.047405 29812 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:43059
I20260805 22:38:06.047451 29940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:43059 every 8 connection(s)
I20260805 22:38:06.047852 29812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:38:06.051323 29798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:06.048792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:46187 (local address 127.19.77.190:38409)
0805 22:38:06.048871 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:06.048874 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:06.049144 (+ 270us) server_negotiation.cc:407] Connection header received
0805 22:38:06.049640 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:06.049641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:06.049649 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:06.049706 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:06.051019 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:06.051021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:06.051022 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:38:06.051026 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:06.051046 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:38:06.051051 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:06.051112 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:06.051247 (+ 135us) server_negotiation.cc:299] Negotiation successful
0805 22:38:06.051264 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260805 22:38:06.051556 29943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:06.048766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38409 (local address 127.19.77.129:46187)
0805 22:38:06.048990 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:06.049027 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:06.049527 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:06.049761 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:06.049764 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:06.049773 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:06.050837 (+ 1064us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:38:06.050838 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:06.050869 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:38:06.050900 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:38:06.051119 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:38:06.051122 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:38:06.051125 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:38:06.051245 (+ 120us) client_negotiation.cc:240] Negotiation successful
0805 22:38:06.051299 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":111,"threads_started":1}
I20260805 22:38:06.052295 29941 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38409
I20260805 22:38:06.052390 29941 heartbeater.cc:464] Registering TS with master...
I20260805 22:38:06.052583 29941 heartbeater.cc:511] Master 127.19.77.190:38409 requested a full tablet report, sending...
I20260805 22:38:06.053210 29752 ts_manager.cc:194] Registered new tserver with Master: 0015f2e20cfc45a8b452446a9f68618a (127.19.77.129:43059)
I20260805 22:38:06.053792 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 29812
I20260805 22:38:06.053900 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:38:06.054102 19766 external_mini_cluster.cc:1428] Setting key 2c6603ae590021c380ca32a714e34604
I20260805 22:38:06.054976 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38409
--builtin_ntp_servers=127.19.77.148:37529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260805 22:38:06.145419 29944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:06.145689 29944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:06.145715 29944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:06.146932 29944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:06.146976 29944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:06.147003 29944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:38:06.148439 29944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:06.148684 29944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:06.148957 29944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:06.154531 29952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:06.154639 29944 server_base.cc:1034] running on GCE node
W20260805 22:38:06.154531 29950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:06.155478 29949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:06.155835 29944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:06.156153 29944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:06.157370 29944 hybrid_clock.cc:648] HybridClock initialized: now 1785969486157345 us; error 50 us; skew 500 ppm
I20260805 22:38:06.158983 29944 webserver.cc:460] Webserver started at http://127.19.77.130:33179/ using document root <none> and password file <none>
I20260805 22:38:06.159336 29944 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:06.159415 29944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:06.159574 29944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:06.160949 29944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "492d1e5a47c2441082a3e31e6a8ba80b"
format_stamp: "Formatted at 2026-08-05 22:38:06 on dist-test-slave-chsk"
server_key: "4d81d9510fd71325d3a15c274ccdbbbb"
server_key_iv: "34cc1518c0a7cbc70a9da197bdfb255a"
server_key_version: "encryptionkey@0"
I20260805 22:38:06.161501 29944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "492d1e5a47c2441082a3e31e6a8ba80b"
format_stamp: "Formatted at 2026-08-05 22:38:06 on dist-test-slave-chsk"
server_key: "4d81d9510fd71325d3a15c274ccdbbbb"
server_key_iv: "34cc1518c0a7cbc70a9da197bdfb255a"
server_key_version: "encryptionkey@0"
I20260805 22:38:06.163358 29944 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260805 22:38:06.164371 29958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:06.164557 29944 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:38:06.164671 29944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "492d1e5a47c2441082a3e31e6a8ba80b"
format_stamp: "Formatted at 2026-08-05 22:38:06 on dist-test-slave-chsk"
server_key: "4d81d9510fd71325d3a15c274ccdbbbb"
server_key_iv: "34cc1518c0a7cbc70a9da197bdfb255a"
server_key_version: "encryptionkey@0"
I20260805 22:38:06.164754 29944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:06.168520 29944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:06.168828 29944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:06.168975 29944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:06.169211 29944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:38:06.169551 29944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:38:06.169606 29944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:06.169648 29944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:38:06.169684 29944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:06.176314 29944 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:45497
I20260805 22:38:06.176371 30072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:45497 every 8 connection(s)
I20260805 22:38:06.176748 29944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:38:06.180583 29798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:06.177706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:58721 (local address 127.19.77.190:38409)
0805 22:38:06.177773 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:06.177775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:06.178037 (+ 262us) server_negotiation.cc:407] Connection header received
0805 22:38:06.178601 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:06.178603 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:06.178610 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:06.178666 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:06.180294 (+ 1628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:06.180296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:06.180296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:38:06.180302 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:06.180321 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:38:06.180325 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:06.180386 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:06.180484 (+ 98us) server_negotiation.cc:299] Negotiation successful
0805 22:38:06.180502 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:38:06.180855 30075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:06.177690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38409 (local address 127.19.77.130:58721)
0805 22:38:06.177892 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:06.177930 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:06.178453 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:06.178752 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:06.178756 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:06.178766 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:06.180107 (+ 1341us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:38:06.180107 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:06.180145 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:38:06.180178 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:38:06.180389 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:38:06.180395 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:38:06.180399 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:38:06.180499 (+ 100us) client_negotiation.cc:240] Negotiation successful
0805 22:38:06.180569 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":78,"threads_started":1}
I20260805 22:38:06.181653 30073 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38409
I20260805 22:38:06.181866 30073 heartbeater.cc:464] Registering TS with master...
I20260805 22:38:06.182078 30073 heartbeater.cc:511] Master 127.19.77.190:38409 requested a full tablet report, sending...
I20260805 22:38:06.182400 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 29944
I20260805 22:38:06.182513 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:38:06.182561 29752 ts_manager.cc:194] Registered new tserver with Master: 492d1e5a47c2441082a3e31e6a8ba80b (127.19.77.130:45497)
I20260805 22:38:06.182736 19766 external_mini_cluster.cc:1428] Setting key 67abf37b25fd390ff98b760d66e79191
I20260805 22:38:06.183961 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38409
--builtin_ntp_servers=127.19.77.148:37529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260805 22:38:06.272014 30076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:06.272245 30076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:06.272269 30076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:06.273478 30076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:06.273522 30076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:06.273554 30076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:38:06.274946 30076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:06.275255 30076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:06.275588 30076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:06.281033 30081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:06.281031 30082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:06.281029 30084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:06.281090 30076 server_base.cc:1034] running on GCE node
I20260805 22:38:06.281481 30076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:06.281747 30076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:06.282922 30076 hybrid_clock.cc:648] HybridClock initialized: now 1785969486282901 us; error 35 us; skew 500 ppm
I20260805 22:38:06.284364 30076 webserver.cc:460] Webserver started at http://127.19.77.131:41831/ using document root <none> and password file <none>
I20260805 22:38:06.284622 30076 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:06.284698 30076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:06.284844 30076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:06.285960 30076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "dcebf6cab8f44cd8acd79e45e3c61efa"
format_stamp: "Formatted at 2026-08-05 22:38:06 on dist-test-slave-chsk"
server_key: "88f6e6cb8a9312996247b9bfad1ad260"
server_key_iv: "d794d27e034545537a3042320a64492c"
server_key_version: "encryptionkey@0"
I20260805 22:38:06.286348 30076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "dcebf6cab8f44cd8acd79e45e3c61efa"
format_stamp: "Formatted at 2026-08-05 22:38:06 on dist-test-slave-chsk"
server_key: "88f6e6cb8a9312996247b9bfad1ad260"
server_key_iv: "d794d27e034545537a3042320a64492c"
server_key_version: "encryptionkey@0"
I20260805 22:38:06.287817 30076 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:38:06.288625 30090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:06.288820 30076 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:38:06.288921 30076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "dcebf6cab8f44cd8acd79e45e3c61efa"
format_stamp: "Formatted at 2026-08-05 22:38:06 on dist-test-slave-chsk"
server_key: "88f6e6cb8a9312996247b9bfad1ad260"
server_key_iv: "d794d27e034545537a3042320a64492c"
server_key_version: "encryptionkey@0"
I20260805 22:38:06.288993 30076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:06.292452 30076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:06.292727 30076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:06.292865 30076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:06.293066 30076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:38:06.293380 30076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:38:06.293431 30076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:06.293470 30076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:38:06.293500 30076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:06.299737 30076 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:35253
I20260805 22:38:06.299820 30205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:35253 every 8 connection(s)
I20260805 22:38:06.300169 30076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:38:06.300690 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 30076
I20260805 22:38:06.300803 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:38:06.301035 19766 external_mini_cluster.cc:1428] Setting key a2dccce1a0b938b3486d93958730f84a
I20260805 22:38:06.303686 29798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:06.300996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:32831 (local address 127.19.77.190:38409)
0805 22:38:06.301041 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:06.301043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:06.301362 (+ 319us) server_negotiation.cc:407] Connection header received
0805 22:38:06.302069 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:06.302069 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:06.302076 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:06.302144 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:06.303431 (+ 1287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:06.303433 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:06.303433 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:38:06.303438 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:06.303453 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:38:06.303457 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:06.303515 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:06.303596 (+ 81us) server_negotiation.cc:299] Negotiation successful
0805 22:38:06.303612 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:38:06.303910 30209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:06.301001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38409 (local address 127.19.77.131:32831)
0805 22:38:06.301242 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:06.301291 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:06.301926 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:06.302218 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:06.302222 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:06.302231 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:06.303276 (+ 1045us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:38:06.303276 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:06.303313 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:38:06.303342 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:38:06.303515 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:38:06.303521 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:38:06.303524 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:38:06.303613 (+ 89us) client_negotiation.cc:240] Negotiation successful
0805 22:38:06.303678 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":103,"threads_started":1}
I20260805 22:38:06.304411 30206 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38409
I20260805 22:38:06.304502 30206 heartbeater.cc:464] Registering TS with master...
I20260805 22:38:06.304682 30206 heartbeater.cc:511] Master 127.19.77.190:38409 requested a full tablet report, sending...
I20260805 22:38:06.305011 29752 ts_manager.cc:194] Registered new tserver with Master: dcebf6cab8f44cd8acd79e45e3c61efa (127.19.77.131:35253)
I20260805 22:38:06.313397 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260805 22:38:06.315608 29798 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:38:06.315011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56688 (local address 127.19.77.190:38409)
0805 22:38:06.315082 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:06.315084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:06.315238 (+ 154us) server_negotiation.cc:407] Connection header received
0805 22:38:06.315304 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:06.315305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:06.315311 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:06.315367 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:06.315529 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56688: BlockingRecv error: recv got EOF from 127.0.0.1:56688 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:38:06.315732 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 29812
I20260805 22:38:06.321631 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 29944
I20260805 22:38:06.327581 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 30076
I20260805 22:38:06.332719 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 29720
2026-08-05T22:38:06Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (588 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:38:06 dist-test-slave-chsk krb5kdc[30217](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:38:06 dist-test-slave-chsk krb5kdc[30217](info): set up 2 sockets
Aug 05 22:38:06 dist-test-slave-chsk krb5kdc[30217](info): commencing operation
krb5kdc: starting...
W20260805 22:38:07.392102 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:38:07 dist-test-slave-chsk krb5kdc[30217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:38:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:38:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:38:07.526655 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:46189
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:46189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:38:07.613006 30230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:07.613301 30230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:07.613348 30230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:07.614939 30230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:38:07.615024 30230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:07.615056 30230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:07.615085 30230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:38:07.615115 30230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:38:07.616871 30230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:46189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:46189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:07.617197 30230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:07.617461 30230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:07.622984 30236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:07.622949 30238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:07.623117 30230 server_base.cc:1034] running on GCE node
W20260805 22:38:07.622987 30235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:07.623648 30230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:07.624182 30230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:07.625408 30230 hybrid_clock.cc:648] HybridClock initialized: now 1785969487625363 us; error 86 us; skew 500 ppm
Aug 05 22:38:07 dist-test-slave-chsk krb5kdc[30217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969487, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:38:07.628882 30230 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:38:07.629457 30230 webserver.cc:460] Webserver started at http://127.19.77.190:34623/ using document root <none> and password file <none>
I20260805 22:38:07.629706 30230 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:07.629757 30230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:07.629912 30230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:07.631212 30230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "f45eddaa409448a999f7a55f4a1c04c3"
format_stamp: "Formatted at 2026-08-05 22:38:07 on dist-test-slave-chsk"
server_key: "0b7a5760829c234f44f0f224c540c646"
server_key_iv: "86af319fe160d236e63881e93d699813"
server_key_version: "encryptionkey@0"
I20260805 22:38:07.631605 30230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "f45eddaa409448a999f7a55f4a1c04c3"
format_stamp: "Formatted at 2026-08-05 22:38:07 on dist-test-slave-chsk"
server_key: "0b7a5760829c234f44f0f224c540c646"
server_key_iv: "86af319fe160d236e63881e93d699813"
server_key_version: "encryptionkey@0"
I20260805 22:38:07.633087 30230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260805 22:38:07.634085 30245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:07.634539 30230 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:38:07.634692 30230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "f45eddaa409448a999f7a55f4a1c04c3"
format_stamp: "Formatted at 2026-08-05 22:38:07 on dist-test-slave-chsk"
server_key: "0b7a5760829c234f44f0f224c540c646"
server_key_iv: "86af319fe160d236e63881e93d699813"
server_key_version: "encryptionkey@0"
I20260805 22:38:07.634779 30230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:07.648656 30230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:07.651230 30230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:07.651409 30230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:07.656119 30230 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:46189
I20260805 22:38:07.656342 30297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:46189 every 8 connection(s)
I20260805 22:38:07.656602 30230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:38:07.657624 30298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:38:07.660130 30298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3: Bootstrap starting.
I20260805 22:38:07.660774 30298 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3: Neither blocks nor log segments found. Creating new log.
I20260805 22:38:07.661087 30298 log.cc:824] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3: Log is configured to *not* fsync() on all Append() calls
I20260805 22:38:07.661931 30298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3: No bootstrap required, opened a new log
I20260805 22:38:07.663173 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 30230
I20260805 22:38:07.663280 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:38:07.663475 19766 external_mini_cluster.cc:1428] Setting key 21507d4aa8b609656edad80eef6aec6c
I20260805 22:38:07.664168 30298 raft_consensus.cc:348] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45eddaa409448a999f7a55f4a1c04c3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46189 } }
I20260805 22:38:07.664351 30298 raft_consensus.cc:374] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:38:07.664378 30298 raft_consensus.cc:729] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45eddaa409448a999f7a55f4a1c04c3, State: Initialized, Role: FOLLOWER
I20260805 22:38:07.664526 30298 consensus_queue.cc:260] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45eddaa409448a999f7a55f4a1c04c3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46189 } }
I20260805 22:38:07.664601 30298 raft_consensus.cc:388] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:38:07.664625 30298 raft_consensus.cc:482] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:38:07.664685 30298 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:38:07.665628 30298 raft_consensus.cc:504] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45eddaa409448a999f7a55f4a1c04c3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46189 } }
I20260805 22:38:07.665722 30298 leader_election.cc:302] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f45eddaa409448a999f7a55f4a1c04c3; no voters:
I20260805 22:38:07.665920 30298 leader_election.cc:288] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:38:07.665988 30303 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:38:07.666143 30303 raft_consensus.cc:686] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [term 1 LEADER]: Becoming Leader. State: Replica: f45eddaa409448a999f7a55f4a1c04c3, State: Running, Role: LEADER
I20260805 22:38:07.666224 30298 sys_catalog.cc:564] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:38:07.666249 30303 consensus_queue.cc:237] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45eddaa409448a999f7a55f4a1c04c3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46189 } }
I20260805 22:38:07.666564 30303 sys_catalog.cc:455] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f45eddaa409448a999f7a55f4a1c04c3. Latest consensus state: current_term: 1 leader_uuid: "f45eddaa409448a999f7a55f4a1c04c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45eddaa409448a999f7a55f4a1c04c3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46189 } } }
I20260805 22:38:07.666637 30303 sys_catalog.cc:458] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [sys.catalog]: This master's current role is: LEADER
I20260805 22:38:07.666589 30304 sys_catalog.cc:455] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f45eddaa409448a999f7a55f4a1c04c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45eddaa409448a999f7a55f4a1c04c3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46189 } } }
I20260805 22:38:07.666850 30304 sys_catalog.cc:458] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3 [sys.catalog]: This master's current role is: LEADER
I20260805 22:38:07.666998 30308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:38:07.668187 30308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:38:07.669967 30308 catalog_manager.cc:1347] Generated new cluster ID: 8d12a89881384f79b8b3655a2fb516b2
I20260805 22:38:07.670030 30308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:38:07 dist-test-slave-chsk krb5kdc[30217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:38:07.676256 30302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:07.664095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43928 (local address 127.19.77.190:46189)
0805 22:38:07.664322 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:07.664330 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:07.664382 (+ 52us) server_negotiation.cc:407] Connection header received
0805 22:38:07.664511 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:07.664519 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:07.664580 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:07.664749 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:07.665444 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:07.666792 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:07.667852 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:07.668519 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:07.668667 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:07.671975 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:07.671986 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:07.671986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:38:07.672015 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:07.674429 (+ 2414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:07.674909 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:07.674915 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:07.674915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:07.675017 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:07.675305 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:07.675306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:07.675306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:07.675581 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:07.675792 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:07.675904 (+ 112us) server_negotiation.cc:299] Negotiation successful
0805 22:38:07.676071 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":103,"threads_started":1}
I20260805 22:38:07.694633 30308 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:38:07.695361 30308 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:38:07.700227 30308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3: Generated new TSK 0
I20260805 22:38:07.700434 30308 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:38:07.739905 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46189
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:38:07.851503 30324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:07.851730 30324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:07.851758 30324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:07.852967 30324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:07.853019 30324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:07.853048 30324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:38:07.854617 30324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:07.854902 30324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:07.855206 30324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:07.860492 30330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:07.860473 30329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:07.860493 30332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:07.860773 30324 server_base.cc:1034] running on GCE node
I20260805 22:38:07.861012 30324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:07.861284 30324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:07.862452 30324 hybrid_clock.cc:648] HybridClock initialized: now 1785969487862434 us; error 40 us; skew 500 ppm
Aug 05 22:38:07 dist-test-slave-chsk krb5kdc[30217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969487, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:38:07.865392 30324 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:38:07.866154 30324 webserver.cc:460] Webserver started at http://127.19.77.129:40421/ using document root <none> and password file <none>
I20260805 22:38:07.866601 30324 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:07.866696 30324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:07.866863 30324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:07.868191 30324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "78cbb0c69a074687a2f9f100d867d323"
format_stamp: "Formatted at 2026-08-05 22:38:07 on dist-test-slave-chsk"
server_key: "b200b618754182aa579940a6789bb817"
server_key_iv: "f5cdec82b999d35f0edb13ebf618ea28"
server_key_version: "encryptionkey@0"
I20260805 22:38:07.868602 30324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "78cbb0c69a074687a2f9f100d867d323"
format_stamp: "Formatted at 2026-08-05 22:38:07 on dist-test-slave-chsk"
server_key: "b200b618754182aa579940a6789bb817"
server_key_iv: "f5cdec82b999d35f0edb13ebf618ea28"
server_key_version: "encryptionkey@0"
I20260805 22:38:07.870219 30324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:38:07.871531 30340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:07.871817 30324 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:38:07.871961 30324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "78cbb0c69a074687a2f9f100d867d323"
format_stamp: "Formatted at 2026-08-05 22:38:07 on dist-test-slave-chsk"
server_key: "b200b618754182aa579940a6789bb817"
server_key_iv: "f5cdec82b999d35f0edb13ebf618ea28"
server_key_version: "encryptionkey@0"
I20260805 22:38:07.872074 30324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:07.893824 30324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:07.896507 30324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:07.896688 30324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:07.896961 30324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:38:07.897315 30324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:38:07.897372 30324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:07.897408 30324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:38:07.897434 30324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:07.903875 30324 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:34997
I20260805 22:38:07.903919 30459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:34997 every 8 connection(s)
I20260805 22:38:07.904259 30324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:38:07.907536 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 30324
I20260805 22:38:07.907636 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:38:07.907823 19766 external_mini_cluster.cc:1428] Setting key 982a9c325f6ba8807db36a8c52b1923d
Aug 05 22:38:07 dist-test-slave-chsk krb5kdc[30217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969487, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:38:07.915913 30302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:07.904976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:45533 (local address 127.19.77.190:46189)
0805 22:38:07.905064 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:07.905066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:07.905437 (+ 371us) server_negotiation.cc:407] Connection header received
0805 22:38:07.905975 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:07.905976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:07.905987 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:07.906053 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:07.907103 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:07.908087 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:07.909999 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:07.910264 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:07.910338 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:07.912899 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:07.912901 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:07.912901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:38:07.912910 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:07.914384 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:07.914840 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:07.914842 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:07.914842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:07.914904 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:07.915207 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:07.915208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:07.915208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:07.915342 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:07.915422 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:07.915724 (+ 302us) server_negotiation.cc:299] Negotiation successful
0805 22:38:07.915816 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260805 22:38:07.916124 30462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:07.904931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:46189 (local address 127.19.77.129:45533)
0805 22:38:07.905154 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:07.905321 (+ 167us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:07.905865 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:07.906113 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:07.906117 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:07.906723 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:07.906923 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:07.906928 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:07.908484 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:07.908485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:07.909863 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:07.909868 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:07.910369 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:07.910370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:07.910529 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:07.911332 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:07.911341 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:07.912776 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:38:07.914481 (+ 1705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:38:07.914490 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:38:07.914492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:38:07.914745 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:38:07.914975 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:38:07.914976 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:38:07.914976 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:38:07.915098 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:38:07.915413 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:38:07.915421 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:38:07.915574 (+ 153us) client_negotiation.cc:769] Sending connection context
0805 22:38:07.915690 (+ 116us) client_negotiation.cc:240] Negotiation successful
0805 22:38:07.915866 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":109,"threads_started":1}
I20260805 22:38:07.916966 30460 heartbeater.cc:347] Connected to a master server at 127.19.77.190:46189
I20260805 22:38:07.917053 30460 heartbeater.cc:464] Registering TS with master...
I20260805 22:38:07.917253 30460 heartbeater.cc:511] Master 127.19.77.190:46189 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:38:07.917852 30262 ts_manager.cc:194] Registered new tserver with Master: 78cbb0c69a074687a2f9f100d867d323 (127.19.77.129:34997)
I20260805 22:38:07.918476 30262 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:45533
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:38:07.936282 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46189
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:38:08.021322 30465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:08.021569 30465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:08.021610 30465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:08.022796 30465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:08.022873 30465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:08.022923 30465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:38:08.024533 30465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:08.024816 30465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:08.025064 30465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:08.030300 30473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:08.030300 30471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:08.030323 30470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:08.030579 30465 server_base.cc:1034] running on GCE node
I20260805 22:38:08.030830 30465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:08.031102 30465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:08.032295 30465 hybrid_clock.cc:648] HybridClock initialized: now 1785969488032273 us; error 43 us; skew 500 ppm
Aug 05 22:38:08 dist-test-slave-chsk krb5kdc[30217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969488, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:38:08.034961 30465 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:38:08.035445 30465 webserver.cc:460] Webserver started at http://127.19.77.130:39725/ using document root <none> and password file <none>
I20260805 22:38:08.035663 30465 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:08.035706 30465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:08.035802 30465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:08.036831 30465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "3e60c006b98a4dc393e60861adc54eb9"
format_stamp: "Formatted at 2026-08-05 22:38:08 on dist-test-slave-chsk"
server_key: "7bdb372c6bc7651b53336d32e89ecde6"
server_key_iv: "184812524af8b1c313f3d784b2b32a5a"
server_key_version: "encryptionkey@0"
I20260805 22:38:08.037382 30465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "3e60c006b98a4dc393e60861adc54eb9"
format_stamp: "Formatted at 2026-08-05 22:38:08 on dist-test-slave-chsk"
server_key: "7bdb372c6bc7651b53336d32e89ecde6"
server_key_iv: "184812524af8b1c313f3d784b2b32a5a"
server_key_version: "encryptionkey@0"
I20260805 22:38:08.038926 30465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:38:08.039873 30482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:08.040112 30465 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:38:08.040189 30465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "3e60c006b98a4dc393e60861adc54eb9"
format_stamp: "Formatted at 2026-08-05 22:38:08 on dist-test-slave-chsk"
server_key: "7bdb372c6bc7651b53336d32e89ecde6"
server_key_iv: "184812524af8b1c313f3d784b2b32a5a"
server_key_version: "encryptionkey@0"
I20260805 22:38:08.040288 30465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:08.047421 30465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:08.049539 30465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:08.049695 30465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:08.050042 30465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:38:08.050442 30465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:38:08.050478 30465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:08.050549 30465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:38:08.050581 30465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:08.057618 30465 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:35329
I20260805 22:38:08.057685 30596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:35329 every 8 connection(s)
I20260805 22:38:08.058007 30465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:38:08.062336 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 30465
I20260805 22:38:08.062476 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:38:08.062708 19766 external_mini_cluster.cc:1428] Setting key 51f11d0641ed4f3179194718c2b4e7cc
Aug 05 22:38:08 dist-test-slave-chsk krb5kdc[30217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969488, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:38:08.068946 30302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.058804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:34743 (local address 127.19.77.190:46189)
0805 22:38:08.058879 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:08.058881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:08.059104 (+ 223us) server_negotiation.cc:407] Connection header received
0805 22:38:08.059655 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:08.059656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:08.059671 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:08.059730 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:08.060691 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.061309 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.062532 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.062798 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.062873 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.065480 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:08.065482 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:08.065483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:38:08.065492 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:08.067385 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:08.067848 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:08.067850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:08.067850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:08.067922 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:08.068234 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:08.068236 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:08.068236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:08.068371 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:08.068448 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:08.068750 (+ 302us) server_negotiation.cc:299] Negotiation successful
0805 22:38:08.068849 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:38:08.069171 30599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.058783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:46189 (local address 127.19.77.130:34743)
0805 22:38:08.058959 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:08.058997 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:08.059558 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:08.059781 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:08.059784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:08.060381 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:08.060586 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.060591 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.061417 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.061418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.062402 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.062406 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.062905 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.062906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.063028 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.063664 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:08.063673 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:08.065395 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:38:08.067482 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:38:08.067491 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:38:08.067493 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:38:08.067761 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:38:08.068026 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:38:08.068027 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:38:08.068027 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:38:08.068159 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:38:08.068451 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:38:08.068459 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:38:08.068614 (+ 155us) client_negotiation.cc:769] Sending connection context
0805 22:38:08.068729 (+ 115us) client_negotiation.cc:240] Negotiation successful
0805 22:38:08.068902 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260805 22:38:08.069715 30597 heartbeater.cc:347] Connected to a master server at 127.19.77.190:46189
I20260805 22:38:08.069810 30597 heartbeater.cc:464] Registering TS with master...
I20260805 22:38:08.070017 30597 heartbeater.cc:511] Master 127.19.77.190:46189 requested a full tablet report, sending...
I20260805 22:38:08.070469 30262 ts_manager.cc:194] Registered new tserver with Master: 3e60c006b98a4dc393e60861adc54eb9 (127.19.77.130:35329)
I20260805 22:38:08.070866 30262 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:34743
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:38:08.094484 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46189
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:38:08.181255 30602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:08.181476 30602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:08.181504 30602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:08.182634 30602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:08.182674 30602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:08.182700 30602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:38:08.184219 30602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:46189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:08.184423 30602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:08.184639 30602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:08.189770 30608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:08.189788 30607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:08.189970 30602 server_base.cc:1034] running on GCE node
W20260805 22:38:08.189724 30611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:08.190291 30602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:08.190549 30602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:08.191718 30602 hybrid_clock.cc:648] HybridClock initialized: now 1785969488191706 us; error 31 us; skew 500 ppm
Aug 05 22:38:08 dist-test-slave-chsk krb5kdc[30217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969488, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:38:08.194430 30602 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:38:08.194914 30602 webserver.cc:460] Webserver started at http://127.19.77.131:34967/ using document root <none> and password file <none>
I20260805 22:38:08.195134 30602 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:08.195251 30602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:08.195351 30602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:38:08.196547 30602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "9e6d396791324264a3bbfbd8e5f51741"
format_stamp: "Formatted at 2026-08-05 22:38:08 on dist-test-slave-chsk"
server_key: "d3501d46e738137d728cabceb1b05da5"
server_key_iv: "2eb7446006fe8cb346c6e8c027361346"
server_key_version: "encryptionkey@0"
I20260805 22:38:08.196873 30602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "9e6d396791324264a3bbfbd8e5f51741"
format_stamp: "Formatted at 2026-08-05 22:38:08 on dist-test-slave-chsk"
server_key: "d3501d46e738137d728cabceb1b05da5"
server_key_iv: "2eb7446006fe8cb346c6e8c027361346"
server_key_version: "encryptionkey@0"
I20260805 22:38:08.198233 30602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:38:08.198994 30619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:08.199256 30602 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:38:08.199347 30602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "9e6d396791324264a3bbfbd8e5f51741"
format_stamp: "Formatted at 2026-08-05 22:38:08 on dist-test-slave-chsk"
server_key: "d3501d46e738137d728cabceb1b05da5"
server_key_iv: "2eb7446006fe8cb346c6e8c027361346"
server_key_version: "encryptionkey@0"
I20260805 22:38:08.199421 30602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:08.219532 30602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:08.221988 30602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:08.222163 30602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:08.222582 30602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:38:08.223356 30602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:38:08.223408 30602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:08.223439 30602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:38:08.223487 30602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:08.230865 30602 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:37117
I20260805 22:38:08.230939 30733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:37117 every 8 connection(s)
I20260805 22:38:08.231454 30602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:38:08 dist-test-slave-chsk krb5kdc[30217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969488, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:38:08.240705 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 30602
I20260805 22:38:08.240820 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:38:08.241050 19766 external_mini_cluster.cc:1428] Setting key f97a376ccd12395758a681e49b9a778f
I20260805 22:38:08.242681 30302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.232472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:37923 (local address 127.19.77.190:46189)
0805 22:38:08.232560 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:08.232563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:08.232807 (+ 244us) server_negotiation.cc:407] Connection header received
0805 22:38:08.233356 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:08.233357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:08.233371 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:08.233417 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:08.234469 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.235016 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.236098 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.236314 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.236389 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.238997 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:08.238999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:08.238999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:38:08.239006 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:08.240950 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:08.241593 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:08.241594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:08.241595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:08.241664 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:08.241956 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:08.241958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:08.241958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:08.242128 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:08.242207 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:08.242490 (+ 283us) server_negotiation.cc:299] Negotiation successful
0805 22:38:08.242576 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 22:38:08.242904 30736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.232445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:46189 (local address 127.19.77.131:37923)
0805 22:38:08.232650 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:08.232697 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:08.233243 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:08.233501 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:08.233507 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:08.234156 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:38:08.234363 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.234367 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.235122 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.235123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.235983 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.235986 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.236413 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.236414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.236545 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.237151 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:38:08.237160 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:38:08.238904 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:38:08.241075 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:38:08.241083 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:38:08.241085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:38:08.241471 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:38:08.241740 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:38:08.241741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:38:08.241741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:38:08.241869 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:38:08.242199 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:38:08.242206 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:38:08.242354 (+ 148us) client_negotiation.cc:769] Sending connection context
0805 22:38:08.242467 (+ 113us) client_negotiation.cc:240] Negotiation successful
0805 22:38:08.242655 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":116,"threads_started":1}
I20260805 22:38:08.243543 30734 heartbeater.cc:347] Connected to a master server at 127.19.77.190:46189
I20260805 22:38:08.243678 30734 heartbeater.cc:464] Registering TS with master...
I20260805 22:38:08.243891 30734 heartbeater.cc:511] Master 127.19.77.190:46189 requested a full tablet report, sending...
I20260805 22:38:08.244294 30262 ts_manager.cc:194] Registered new tserver with Master: 9e6d396791324264a3bbfbd8e5f51741 (127.19.77.131:37117)
I20260805 22:38:08.244700 30262 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:37923
I20260805 22:38:08.253132 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:38:08.261051 30302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.254680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43938 (local address 127.19.77.190:46189)
0805 22:38:08.254767 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:08.254770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:08.254798 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:38:08.254889 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:08.254891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:08.254902 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:08.254979 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:08.255635 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.256146 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.256875 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.257099 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.257178 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.258502 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:08.258504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:08.258504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:38:08.258511 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:08.259761 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:08.260143 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:08.260144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:08.260144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:08.260216 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:08.260418 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:08.260419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:08.260420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:08.260585 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:08.260699 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:08.260838 (+ 139us) server_negotiation.cc:299] Negotiation successful
0805 22:38:08.260932 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 22:38:08.262823 30262 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43938:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:38:08.264623 30262 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:38:08.271970 30752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.267837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59090 (local address 127.19.77.129:34997)
0805 22:38:08.268049 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:08.268053 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:08.268078 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:38:08.268124 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:08.268126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:08.268145 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:08.268441 (+ 296us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:38:08.268520 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.269629 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.270898 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.271531 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.271628 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.271688 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:08.271839 (+ 151us) server_negotiation.cc:299] Negotiation successful
0805 22:38:08.271885 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":110,"threads_started":1}
I20260805 22:38:08.271957 30747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.267370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:34997 (local address 127.0.0.1:59090)
0805 22:38:08.267571 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:08.267619 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:08.267703 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:08.268268 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:08.268271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:08.268274 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:38:08.268359 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.268361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.269749 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.269750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.270805 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.270807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.271620 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.271621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.271707 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.271721 (+ 14us) client_negotiation.cc:769] Sending connection context
0805 22:38:08.271810 (+ 89us) client_negotiation.cc:240] Negotiation successful
0805 22:38:08.271873 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":75,"threads_started":1}
I20260805 22:38:08.272337 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.267607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:37117 (local address 127.0.0.1:39152)
0805 22:38:08.268033 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:08.268043 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:08.268123 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:08.268345 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:08.268346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:08.268347 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:38:08.268377 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.268379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.269772 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.269773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.270643 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.270646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.272091 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.272092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.272173 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.272177 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:38:08.272236 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:38:08.272276 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":26,"thread_start_us":77,"threads_started":1}
I20260805 22:38:08.272500 30750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.267743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39152 (local address 127.19.77.131:37117)
0805 22:38:08.267900 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:08.267905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:08.268123 (+ 218us) server_negotiation.cc:407] Connection header received
0805 22:38:08.268190 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:08.268192 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:08.268209 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:08.268282 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:38:08.268459 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.269621 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.270760 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.271527 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.271611 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.271674 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:08.272291 (+ 617us) server_negotiation.cc:299] Negotiation successful
0805 22:38:08.272341 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260805 22:38:08.272946 30393 tablet_service.cc:1467] Processing CreateTablet for tablet 4c56769165004801b807944ffe7a9966 (DEFAULT_TABLE table=test-table [id=997fb5d3aafd4119bff34a4afe32538b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:38:08.273406 30393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c56769165004801b807944ffe7a9966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:38:08.275684 30746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.267398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:35329 (local address 127.0.0.1:36136)
0805 22:38:08.267706 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:08.267720 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:08.267777 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:08.268414 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:08.268415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:08.268417 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:38:08.268478 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.268480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.269347 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.269348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.270633 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.270636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.275376 (+ 4740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.275377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.275450 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.275454 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:38:08.275534 (+ 80us) client_negotiation.cc:240] Negotiation successful
0805 22:38:08.275588 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":3,"thread_start_us":114,"threads_started":1}
I20260805 22:38:08.275997 30748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.267488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36136 (local address 127.19.77.130:35329)
0805 22:38:08.268260 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:08.268264 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:08.268275 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:38:08.268319 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:08.268321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:08.268338 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:08.268416 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:38:08.268536 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.269242 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.270734 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.271527 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.271611 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.271674 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:08.275807 (+ 4133us) server_negotiation.cc:299] Negotiation successful
0805 22:38:08.275869 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":730,"thread_start_us":115,"threads_started":1}
I20260805 22:38:08.275964 30667 tablet_service.cc:1467] Processing CreateTablet for tablet 4c56769165004801b807944ffe7a9966 (DEFAULT_TABLE table=test-table [id=997fb5d3aafd4119bff34a4afe32538b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:38:08.276345 30667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c56769165004801b807944ffe7a9966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:38:08.276650 30753 tablet_bootstrap.cc:492] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323: Bootstrap starting.
I20260805 22:38:08.277428 30753 tablet_bootstrap.cc:654] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323: Neither blocks nor log segments found. Creating new log.
I20260805 22:38:08.278105 30753 log.cc:824] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323: Log is configured to *not* fsync() on all Append() calls
I20260805 22:38:08.278942 30753 tablet_bootstrap.cc:492] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323: No bootstrap required, opened a new log
I20260805 22:38:08.279018 30753 ts_tablet_manager.cc:1397] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:38:08.280113 30755 tablet_bootstrap.cc:492] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: Bootstrap starting.
I20260805 22:38:08.280922 30755 tablet_bootstrap.cc:654] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: Neither blocks nor log segments found. Creating new log.
I20260805 22:38:08.280941 30530 tablet_service.cc:1467] Processing CreateTablet for tablet 4c56769165004801b807944ffe7a9966 (DEFAULT_TABLE table=test-table [id=997fb5d3aafd4119bff34a4afe32538b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:38:08.281045 30753 raft_consensus.cc:348] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78cbb0c69a074687a2f9f100d867d323" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34997 } } peers { permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 } } peers { permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 } }
I20260805 22:38:08.281260 30753 raft_consensus.cc:374] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:38:08.281304 30753 raft_consensus.cc:729] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78cbb0c69a074687a2f9f100d867d323, State: Initialized, Role: FOLLOWER
I20260805 22:38:08.281347 30530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c56769165004801b807944ffe7a9966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:38:08.281419 30753 consensus_queue.cc:260] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78cbb0c69a074687a2f9f100d867d323" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34997 } } peers { permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 } } peers { permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 } }
I20260805 22:38:08.281602 30755 log.cc:824] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: Log is configured to *not* fsync() on all Append() calls
I20260805 22:38:08.281693 30753 ts_tablet_manager.cc:1428] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:38:08.281836 30460 heartbeater.cc:503] Master 127.19.77.190:46189 was elected leader, sending a full tablet report...
I20260805 22:38:08.282704 30755 tablet_bootstrap.cc:492] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: No bootstrap required, opened a new log
I20260805 22:38:08.282792 30755 ts_tablet_manager.cc:1397] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:38:08.284602 30755 raft_consensus.cc:348] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78cbb0c69a074687a2f9f100d867d323" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34997 } } peers { permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 } } peers { permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 } }
I20260805 22:38:08.284755 30755 raft_consensus.cc:374] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:38:08.284801 30755 raft_consensus.cc:729] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6d396791324264a3bbfbd8e5f51741, State: Initialized, Role: FOLLOWER
I20260805 22:38:08.284816 30758 tablet_bootstrap.cc:492] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: Bootstrap starting.
I20260805 22:38:08.284917 30755 consensus_queue.cc:260] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78cbb0c69a074687a2f9f100d867d323" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34997 } } peers { permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 } } peers { permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 } }
I20260805 22:38:08.285216 30755 ts_tablet_manager.cc:1428] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 22:38:08.285363 30734 heartbeater.cc:503] Master 127.19.77.190:46189 was elected leader, sending a full tablet report...
I20260805 22:38:08.285579 30758 tablet_bootstrap.cc:654] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: Neither blocks nor log segments found. Creating new log.
I20260805 22:38:08.286196 30758 log.cc:824] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: Log is configured to *not* fsync() on all Append() calls
I20260805 22:38:08.287070 30758 tablet_bootstrap.cc:492] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: No bootstrap required, opened a new log
I20260805 22:38:08.287181 30758 ts_tablet_manager.cc:1397] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:38:08.288515 30758 raft_consensus.cc:348] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78cbb0c69a074687a2f9f100d867d323" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34997 } } peers { permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 } } peers { permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 } }
I20260805 22:38:08.288686 30758 raft_consensus.cc:374] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:38:08.288738 30758 raft_consensus.cc:729] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e60c006b98a4dc393e60861adc54eb9, State: Initialized, Role: FOLLOWER
I20260805 22:38:08.288858 30758 consensus_queue.cc:260] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78cbb0c69a074687a2f9f100d867d323" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34997 } } peers { permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 } } peers { permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 } }
I20260805 22:38:08.289157 30758 ts_tablet_manager.cc:1428] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:38:08.289238 30597 heartbeater.cc:503] Master 127.19.77.190:46189 was elected leader, sending a full tablet report...
W20260805 22:38:08.308676 30598 tablet.cc:2369] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:38:08.405071 30461 tablet.cc:2369] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:38:08.409163 30756 raft_consensus.cc:482] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:38:08.409304 30756 raft_consensus.cc:504] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78cbb0c69a074687a2f9f100d867d323" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34997 } } peers { permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 } } peers { permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 } }
I20260805 22:38:08.409742 30756 leader_election.cc:288] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e60c006b98a4dc393e60861adc54eb9 (127.19.77.130:35329), 9e6d396791324264a3bbfbd8e5f51741 (127.19.77.131:37117)
I20260805 22:38:08.414090 30748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.410172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:54355 (local address 127.19.77.130:35329)
0805 22:38:08.410219 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:08.410221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:08.410324 (+ 103us) server_negotiation.cc:407] Connection header received
0805 22:38:08.410381 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:08.410382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:08.410392 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:08.410458 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:38:08.410621 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.411382 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.413052 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.413658 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.413747 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.413757 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:08.413964 (+ 207us) server_negotiation.cc:299] Negotiation successful
0805 22:38:08.414011 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:38:08.414139 30750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.410150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:53155 (local address 127.19.77.131:37117)
0805 22:38:08.410203 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:08.410206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:08.410218 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:38:08.410250 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:08.410251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:08.410268 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:08.410352 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:38:08.410597 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.411392 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.413051 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.413658 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.413747 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.413757 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:08.413970 (+ 213us) server_negotiation.cc:299] Negotiation successful
0805 22:38:08.414068 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:38:08.414130 30462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.410003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:37117 (local address 127.19.77.129:53155)
0805 22:38:08.410089 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:08.410106 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:08.410163 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:08.410378 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:08.410379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:08.410381 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:38:08.410486 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.410488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.411507 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.411509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.412913 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.412917 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.413774 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.413775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.413874 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.413877 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:38:08.413946 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:38:08.414014 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":69}
I20260805 22:38:08.414137 30762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.410089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:35329 (local address 127.19.77.129:54355)
0805 22:38:08.410238 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:08.410253 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:38:08.410306 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:38:08.410472 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:38:08.410473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:38:08.410474 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:38:08.410546 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.410548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.411507 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.411509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.412913 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:38:08.412917 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.413774 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.413775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:38:08.413869 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.413874 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:38:08.413946 (+ 72us) client_negotiation.cc:240] Negotiation successful
0805 22:38:08.414013 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":115,"thread_start_us":69,"threads_started":1}
I20260805 22:38:08.414587 30687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c56769165004801b807944ffe7a9966" candidate_uuid: "78cbb0c69a074687a2f9f100d867d323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6d396791324264a3bbfbd8e5f51741" is_pre_election: true
I20260805 22:38:08.414638 30551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c56769165004801b807944ffe7a9966" candidate_uuid: "78cbb0c69a074687a2f9f100d867d323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e60c006b98a4dc393e60861adc54eb9" is_pre_election: true
I20260805 22:38:08.414764 30687 raft_consensus.cc:2454] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78cbb0c69a074687a2f9f100d867d323 in term 0.
I20260805 22:38:08.414855 30551 raft_consensus.cc:2454] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78cbb0c69a074687a2f9f100d867d323 in term 0.
I20260805 22:38:08.415093 30341 leader_election.cc:302] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78cbb0c69a074687a2f9f100d867d323, 9e6d396791324264a3bbfbd8e5f51741; no voters:
I20260805 22:38:08.415274 30756 raft_consensus.cc:2781] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:38:08.415352 30756 raft_consensus.cc:482] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:38:08.415398 30756 raft_consensus.cc:3037] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:38:08.416189 30756 raft_consensus.cc:504] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78cbb0c69a074687a2f9f100d867d323" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34997 } } peers { permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 } } peers { permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 } }
I20260805 22:38:08.416361 30756 leader_election.cc:288] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [CANDIDATE]: Term 1 election: Requested vote from peers 3e60c006b98a4dc393e60861adc54eb9 (127.19.77.130:35329), 9e6d396791324264a3bbfbd8e5f51741 (127.19.77.131:37117)
I20260805 22:38:08.416543 30551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c56769165004801b807944ffe7a9966" candidate_uuid: "78cbb0c69a074687a2f9f100d867d323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e60c006b98a4dc393e60861adc54eb9"
I20260805 22:38:08.416551 30687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c56769165004801b807944ffe7a9966" candidate_uuid: "78cbb0c69a074687a2f9f100d867d323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6d396791324264a3bbfbd8e5f51741"
I20260805 22:38:08.416653 30687 raft_consensus.cc:3037] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:38:08.416658 30551 raft_consensus.cc:3037] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:38:08.417408 30687 raft_consensus.cc:2454] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78cbb0c69a074687a2f9f100d867d323 in term 1.
I20260805 22:38:08.417574 30551 raft_consensus.cc:2454] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78cbb0c69a074687a2f9f100d867d323 in term 1.
I20260805 22:38:08.417587 30341 leader_election.cc:302] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78cbb0c69a074687a2f9f100d867d323, 9e6d396791324264a3bbfbd8e5f51741; no voters:
I20260805 22:38:08.417725 30756 raft_consensus.cc:2781] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:38:08.417946 30756 raft_consensus.cc:686] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [term 1 LEADER]: Becoming Leader. State: Replica: 78cbb0c69a074687a2f9f100d867d323, State: Running, Role: LEADER
I20260805 22:38:08.418062 30756 consensus_queue.cc:237] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78cbb0c69a074687a2f9f100d867d323" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34997 } } peers { permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 } } peers { permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 } }
I20260805 22:38:08.418987 30261 catalog_manager.cc:5495] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78cbb0c69a074687a2f9f100d867d323 (127.19.77.129). New cstate: current_term: 1 leader_uuid: "78cbb0c69a074687a2f9f100d867d323" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78cbb0c69a074687a2f9f100d867d323" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 } health_report { overall_health: UNKNOWN } } }
I20260805 22:38:08.456606 30752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.453957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59106 (local address 127.19.77.129:34997)
0805 22:38:08.454043 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:08.454045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:08.454054 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:38:08.454112 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:08.454113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:08.454133 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:08.454209 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:38:08.454383 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.454963 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.455758 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:08.455954 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:08.456035 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:08.456230 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:38:08.456343 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:38:08.456439 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:08.456467 (+ 28us) server_negotiation.cc:299] Negotiation successful
0805 22:38:08.456488 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260805 22:38:08.458531 30687 raft_consensus.cc:1261] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741 [term 1 FOLLOWER]: Refusing update from remote peer 78cbb0c69a074687a2f9f100d867d323: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:38:08.458554 30551 raft_consensus.cc:1261] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9 [term 1 FOLLOWER]: Refusing update from remote peer 78cbb0c69a074687a2f9f100d867d323: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:38:08.458891 30756 consensus_queue.cc:1035] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e60c006b98a4dc393e60861adc54eb9" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:38:08.459040 30763 consensus_queue.cc:1035] T 4c56769165004801b807944ffe7a9966 P 78cbb0c69a074687a2f9f100d867d323 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6d396791324264a3bbfbd8e5f51741" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:38:08.462091 30768 mvcc.cc:205] Tried to move back new op lower bound from 7315331024723488768 to 7315331024561102848. Current Snapshot: MvccSnapshot[applied={T|T < 7315331024723488768}]
I20260805 22:38:08.462215 30766 mvcc.cc:205] Tried to move back new op lower bound from 7315331024723488768 to 7315331024561102848. Current Snapshot: MvccSnapshot[applied={T|T < 7315331024723488768 or (T in {7315331024723488768})}]
I20260805 22:38:08.462576 30767 mvcc.cc:205] Tried to move back new op lower bound from 7315331024723488768 to 7315331024561102848. Current Snapshot: MvccSnapshot[applied={T|T < 7315331024723488768 or (T in {7315331024723488768})}]
I20260805 22:38:08.464429 30261 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:38:08.464550 30261 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:38:08.465386 30261 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f45eddaa409448a999f7a55f4a1c04c3: Sending DeleteTablet for 3 replicas of tablet 4c56769165004801b807944ffe7a9966
I20260805 22:38:08.465792 30667 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c56769165004801b807944ffe7a9966 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:38:08 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:39152
I20260805 22:38:08.465811 30393 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c56769165004801b807944ffe7a9966 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:38:08 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:59090
I20260805 22:38:08.466073 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 30324
I20260805 22:38:08.466148 30530 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c56769165004801b807944ffe7a9966 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:38:08 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:36136
I20260805 22:38:08.466941 30776 tablet_replica.cc:330] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: stopping tablet replica
I20260805 22:38:08.467119 30776 raft_consensus.cc:2229] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:38:08.467320 30776 raft_consensus.cc:2258] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:38:08.468163 30776 ts_tablet_manager.cc:1905] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:38:08.468685 30777 tablet_replica.cc:330] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: stopping tablet replica
I20260805 22:38:08.468817 30777 raft_consensus.cc:2229] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:38:08.468933 30777 raft_consensus.cc:2258] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:38:08.469440 30777 ts_tablet_manager.cc:1905] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:38:08.470729 30776 ts_tablet_manager.cc:1918] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:38:08.470817 30776 log.cc:1196] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/4c56769165004801b807944ffe7a9966
I20260805 22:38:08.471074 30777 ts_tablet_manager.cc:1918] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:38:08.471134 30776 ts_tablet_manager.cc:1939] T 4c56769165004801b807944ffe7a9966 P 9e6d396791324264a3bbfbd8e5f51741: Deleting consensus metadata
I20260805 22:38:08.471186 30777 log.cc:1196] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/4c56769165004801b807944ffe7a9966
I20260805 22:38:08.471465 30777 ts_tablet_manager.cc:1939] T 4c56769165004801b807944ffe7a9966 P 3e60c006b98a4dc393e60861adc54eb9: Deleting consensus metadata
I20260805 22:38:08.471644 30246 catalog_manager.cc:4841] TS 9e6d396791324264a3bbfbd8e5f51741 (127.19.77.131:37117): tablet 4c56769165004801b807944ffe7a9966 (table test-table [id=997fb5d3aafd4119bff34a4afe32538b]) successfully deleted
I20260805 22:38:08.472025 30249 catalog_manager.cc:4841] TS 3e60c006b98a4dc393e60861adc54eb9 (127.19.77.130:35329): tablet 4c56769165004801b807944ffe7a9966 (table test-table [id=997fb5d3aafd4119bff34a4afe32538b]) successfully deleted
W20260805 22:38:08.473902 30246 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:34997 (error 108)
I20260805 22:38:08.474203 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 30465
I20260805 22:38:08.477344 30746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:08.477170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:34997 (local address 127.0.0.1:59116)
0805 22:38:08.477254 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0805 22:38:08.477310 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260805 22:38:08.477512 30246 catalog_manager.cc:4584] TS 78cbb0c69a074687a2f9f100d867d323 (127.19.77.129:34997): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4c56769165004801b807944ffe7a9966: Network error: Client connection negotiation failed: client connection to 127.19.77.129:34997: connect: Connection refused (error 111)
I20260805 22:38:08.481106 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 30602
I20260805 22:38:08.486853 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 30230
2026-08-05T22:38:08Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2154 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:38:08 dist-test-slave-chsk krb5kdc[30781](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:38:08 dist-test-slave-chsk krb5kdc[30781](info): set up 2 sockets
Aug 05 22:38:08 dist-test-slave-chsk krb5kdc[30781](info): commencing operation
krb5kdc: starting...
W20260805 22:38:09.556232 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:38:09 dist-test-slave-chsk krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:38:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:38:09Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.77.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.77.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/rangeradmin_127.19.77.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/rangeradmin_127.19.77.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.77.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.77.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/rangerlookup_127.19.77.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/rangerlookup_127.19.77.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.77.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.77.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/HTTP_127.19.77.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/HTTP_127.19.77.148@KRBTEST.COM.keytab.
I20260805 22:38:09.759840 19766 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskDgpMZH/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/postgres -l logfile start
2026-08-05 22:38:12.651 UTC [30812] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-05 22:38:12.651 UTC [30812] LOG: listening on IPv4 address "127.19.77.148", port 53669
2026-08-05 22:38:12.656 UTC [30812] LOG: listening on Unix socket "/tmp/.s.PGSQL.53669"
2026-08-05 22:38:12.681 UTC [30815] LOG: database system was shut down at 2026-08-05 22:38:10 UTC
2026-08-05 22:38:12.685 UTC [30812] LOG: database system is ready to accept connections
I20260805 22:38:13.660178 19766 mini_postgres.cc:96] Postgres bound to 53669
2026-08-05 22:38:13.669 UTC [30824] FATAL: database "slave" does not exist
127.19.77.148:53669 - accepting connections
I20260805 22:38:13.671218 19766 mini_ranger.cc:161] Starting Ranger...
I20260805 22:38:13.690205 19766 mini_ranger.cc:84] Created miniranger Postgres user
I20260805 22:38:14.243690 19766 mini_ranger.cc:87] Created ranger Postgres database
I20260805 22:38:14.243803 19766 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-admin
2026-08-05 22:38:14,605 [I] DB FLAVOR :POSTGRES
2026-08-05 22:38:14,606 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:38:14,606 [I] Checking connection..
2026-08-05 22:38:14,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-05 22:38:14,882 [I] Checking connection passed.
2026-08-05 22:38:14,882 [I] --------- Verifying version history table ---------
2026-08-05 22:38:14,883 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:38:15,145 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:38:15,145 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:38:15,444 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:38:15,444 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-05 22:38:15,445 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-05 22:38:15.747 UTC [30891] WARNING: there is no transaction in progress
2026-08-05 22:38:15,756 [I] create_dbversion_catalog.sql file imported successfully
2026-08-05 22:38:15,757 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:38:16,042 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-05 22:38:16,043 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:38:16,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-05 22:38:16,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-05 22:38:16,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-chsk.c.gcp-upstream.internal','N') ;"
2026-08-05 22:38:16,893 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:38:17,163 [I] Table x_portal_user does not exist in database ranger
2026-08-05 22:38:17,163 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:38:17,425 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-05 22:38:17,425 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:38:17,702 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:38:17,963 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-05 22:38:17,964 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-05 22:38:19.060 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.080 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.100 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.117 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.137 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.159 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.224 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.232 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.249 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.262 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.275 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.290 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.301 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.309 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.317 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:19.325 UTC [31001] WARNING: there is no transaction in progress
2026-08-05 22:38:20,045 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-05 22:38:20,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-05 22:38:20,303 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-05 22:38:20,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:38:20,585 [I] Table x_portal_user already exists in database 'ranger'
2026-08-05 22:38:20,586 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:38:20,847 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-05 22:38:20,847 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:38:21,111 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:38:21,387 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-chsk.c.gcp-upstream.internal';"
2026-08-05 22:38:21,657 [I] CORE_DB_SCHEMA import status has been updated
2026-08-05 22:38:21,657 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-05 22:38:21,930 [I] DB_PATCHES have already been applied
I20260805 22:38:21.936800 19766 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-admin:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskDgpMZH/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260805 22:38:21.936910 19766 mini_ranger.cc:193] Using host: 127.19.77.148
I20260805 22:38:21.940946 19766 mini_ranger.cc:227] Ranger admin URL: http://127.19.77.148:55695
Aug 05, 2026 10:38:22 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:38:22 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:38:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-admin/ews/webapp
Aug 05, 2026 10:38:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 05, 2026 10:38:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 05, 2026 10:38:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-admin/ews/webapp].
Aug 05, 2026 10:38:23 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260805 22:38:24.354722 19766 mini_ranger.cc:160] Time spent starting Ranger: real 10.684s user 0.002s sys 0.013s
Aug 05, 2026 10:38:46 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 05, 2026 10:38:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 05, 2026 10:38:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 05, 2026 10:38:46 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 05, 2026 10:38:47 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260805 22:38:48.249205 19766 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.77.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.77.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/rangerkms_127.19.77.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/rangerkms_127.19.77.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.77.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.77.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.77.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/HTTP_127.19.77.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.77.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/HTTP_127.19.77.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 05 22:38:48 dist-test-slave-chsk krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969528, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260805 22:38:48.369305 19766 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260805 22:38:48.384044 19766 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260805 22:38:49.474766 19766 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260805 22:38:49.474865 19766 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-kms
I20260805 22:38:49.474890 19766 mini_ranger_kms.cc:227] Using postgres at 127.19.77.148:53669
2026-08-05 22:38:50,162 [I] DB FLAVOR :POSTGRES
2026-08-05 22:38:50,163 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:38:50,163 [I] Checking connection
2026-08-05 22:38:50,163 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-05 22:38:50,489 [I] connection success
2026-08-05 22:38:50,489 [I] --------- Verifying Ranger DB tables ---------
2026-08-05 22:38:50,489 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-05 22:38:50,489 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-05 22:38:50,768 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-05 22:38:50,769 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:38:50,769 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-05 22:38:50,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:53669/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-05 22:38:51,068 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260805 22:38:51.632977 19766 mini_ranger_kms.cc:310] Created kms service
I20260805 22:38:51.834940 19766 mini_ranger_kms.cc:326] Created kudu user
I20260805 22:38:51.885311 19766 mini_ranger_kms.cc:343] Created rangerkms user
Aug 05 22:38:51 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969528, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:38:52.344831 19766 mini_ranger_kms.cc:384] Added ranger policy
I20260805 22:38:52.344972 19766 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-kms:/tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260805 22:38:52.344993 19766 mini_ranger_kms.cc:240] Using host: 127.19.77.148
I20260805 22:38:52.351490 19766 mini_ranger_kms.cc:276] Ranger KMS PID: 31189
I20260805 22:38:52.351648 19766 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.77.148:39425
Aug 05, 2026 10:38:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:38:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:38:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 05, 2026 10:38:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 05, 2026 10:38:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-kms/ews/webapp].
Aug 05, 2026 10:38:54 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260805 22:38:54.725857 19766 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.357s user 0.007s sys 0.653s
I20260805 22:38:54.725973 19766 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260805 22:38:54.726050 19766 mini_ranger_kms.cc:401] 127.19.77.148:39425/kms/v1/keys
Aug 05 22:38:55 dist-test-slave-chsk krb5kdc[30781](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785969535, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.77.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 05 22:38:55 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969535, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.77.148@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
Aug 05 22:38:56 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969535, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.77.148@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
Aug 05 22:38:58 dist-test-slave-chsk krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:38:58.766901 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:38059
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:38059
--ranger_config_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:39425/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:38:58.877941 31242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:38:58.878189 31242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:38:58.878213 31242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:38:58.879626 31242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:38:58.879678 31242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:38:58.879693 31242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:38:58.879707 31242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:38:58.879720 31242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:38:58.881604 31242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.77.148:39425/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:38059
--ranger_config_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:38059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:38:58.881876 31242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:38:58.882165 31242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:38:58.888008 31250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:58.887979 31247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:38:58.888036 31248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:38:58.888230 31242 server_base.cc:1034] running on GCE node
I20260805 22:38:58.888628 31242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:38:58.888939 31242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:38:58.890134 31242 hybrid_clock.cc:648] HybridClock initialized: now 1785969538890107 us; error 45 us; skew 500 ppm
Aug 05 22:38:58 dist-test-slave-chsk krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969538, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:38:58.893656 31242 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:38:58.894213 31242 webserver.cc:460] Webserver started at http://127.19.77.190:43429/ using document root <none> and password file <none>
I20260805 22:38:58.894448 31242 fs_manager.cc:359] Metadata directory not provided
I20260805 22:38:58.894492 31242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:38:58.894629 31242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:38:58 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969538, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:38:58.946847 31242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "7b0c2af028ef4c958e055376b2ace4d7"
format_stamp: "Formatted at 2026-08-05 22:38:58 on dist-test-slave-chsk"
server_key: "c18daaeb5bc35906348d007b5baab508"
server_key_iv: "0bf344132831d947bdab64ab7b9b4cc7"
server_key_version: "kuduclusterkey@0"
I20260805 22:38:58.947372 31242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "7b0c2af028ef4c958e055376b2ace4d7"
format_stamp: "Formatted at 2026-08-05 22:38:58 on dist-test-slave-chsk"
server_key: "c18daaeb5bc35906348d007b5baab508"
server_key_iv: "0bf344132831d947bdab64ab7b9b4cc7"
server_key_version: "kuduclusterkey@0"
I20260805 22:38:58.949127 31242 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:38:58.962080 31257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:38:58.962329 31242 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:38:58.962440 31242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "7b0c2af028ef4c958e055376b2ace4d7"
format_stamp: "Formatted at 2026-08-05 22:38:58 on dist-test-slave-chsk"
server_key: "c18daaeb5bc35906348d007b5baab508"
server_key_iv: "0bf344132831d947bdab64ab7b9b4cc7"
server_key_version: "kuduclusterkey@0"
I20260805 22:38:58.962563 31242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:38:58.977604 31242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:38:58.979818 31242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:38:58.980065 31242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:38:58.989392 31242 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:38059
I20260805 22:38:58.989493 31312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:38059 every 8 connection(s)
I20260805 22:38:58.989943 31242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:38:58.990790 31313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:38:58.993649 31313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7: Bootstrap starting.
I20260805 22:38:58.994438 31313 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7: Neither blocks nor log segments found. Creating new log.
I20260805 22:38:58.994751 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 31242
I20260805 22:38:58.994941 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:38:58.995116 31313 log.cc:824] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:38:58.995195 19766 external_mini_cluster.cc:1428] Setting key eba780c171e9732c1ea72a5171809f22
I20260805 22:38:58.996196 31313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7: No bootstrap required, opened a new log
I20260805 22:38:58.999177 31313 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0c2af028ef4c958e055376b2ace4d7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38059 } }
I20260805 22:38:58.999368 31313 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:38:58.999405 31313 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b0c2af028ef4c958e055376b2ace4d7, State: Initialized, Role: FOLLOWER
I20260805 22:38:58.999609 31313 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0c2af028ef4c958e055376b2ace4d7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38059 } }
I20260805 22:38:58.999697 31313 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:38:58.999727 31313 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:38:58.999792 31313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:38:59.000528 31313 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0c2af028ef4c958e055376b2ace4d7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38059 } }
I20260805 22:38:59.000658 31313 leader_election.cc:302] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b0c2af028ef4c958e055376b2ace4d7; no voters:
I20260805 22:38:59.000872 31313 leader_election.cc:288] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:38:59.001063 31318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:38:59.001293 31313 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:38:59.001296 31318 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7b0c2af028ef4c958e055376b2ace4d7, State: Running, Role: LEADER
I20260805 22:38:59.001546 31318 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0c2af028ef4c958e055376b2ace4d7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38059 } }
I20260805 22:38:59.002036 31318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b0c2af028ef4c958e055376b2ace4d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0c2af028ef4c958e055376b2ace4d7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38059 } } }
I20260805 22:38:59.002226 31318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:38:59.002514 31318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b0c2af028ef4c958e055376b2ace4d7. Latest consensus state: current_term: 1 leader_uuid: "7b0c2af028ef4c958e055376b2ace4d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0c2af028ef4c958e055376b2ace4d7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38059 } } }
I20260805 22:38:59.002638 31318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:38:59.002887 31327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 05 22:38:59 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:38:59.003782 31327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:38:59.004330 31313 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 22:38:59.015246 31335 mvcc.cc:205] Tried to move back new op lower bound from 7315331231784497152 to 7315331231750914048. Current Snapshot: MvccSnapshot[applied={T|T < 7315331231784497152}]
I20260805 22:38:59.015748 31317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:38:58.995743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38958 (local address 127.19.77.190:38059)
0805 22:38:58.995911 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0805 22:38:58.995922 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:38:58.995963 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:38:58.996511 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:38:58.996521 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:38:58.996585 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:38:58.996743 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:38:58.997710 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:58.998994 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:59.000111 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:38:59.000703 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:38:59.000810 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:38:59.003877 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:38:59.003882 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:38:59.003883 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:38:59.003895 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:38:59.011004 (+ 7109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:59.011948 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:59.011953 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:59.011954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:59.012308 (+ 354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:38:59.012584 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:38:59.012585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:38:59.012586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:38:59.013443 (+ 857us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:38:59.014526 (+ 1083us) server_negotiation.cc:1035] Waiting for connection context
0805 22:38:59.014637 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 22:38:59.015244 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260805 22:38:59.020447 31327 catalog_manager.cc:1347] Generated new cluster ID: e123ed426ee24a4dbd1d94ab1b8a3f7b
I20260805 22:38:59.020541 31327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:38:59.059259 31327 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:38:59.060259 31327 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:38:59.064668 31327 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7: Generated new TSK 0
I20260805 22:38:59.064952 31327 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:39:00.047324 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:39425/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38059
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:39:00.174471 31360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:00.174767 31360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:00.174813 31360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:00.176280 31360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:00.176362 31360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:00.176414 31360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:39:00.178315 31360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.77.148:39425/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:00.178601 31360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:00.178876 31360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:00.187369 31366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:00.187347 31365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:00.187362 31368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:00.188019 31360 server_base.cc:1034] running on GCE node
I20260805 22:39:00.188273 31360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:00.188561 31360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:00.189733 31360 hybrid_clock.cc:648] HybridClock initialized: now 1785969540189720 us; error 34 us; skew 500 ppm
Aug 05 22:39:00 dist-test-slave-chsk krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969540, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:00.193637 31360 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:39:00.194324 31360 webserver.cc:460] Webserver started at http://127.19.77.129:44593/ using document root <none> and password file <none>
I20260805 22:39:00.194675 31360 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:00.194756 31360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:00.194970 31360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:39:00 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969540, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:00.211793 31360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "1e565281ed394c9292ae2b613c4b108a"
format_stamp: "Formatted at 2026-08-05 22:39:00 on dist-test-slave-chsk"
server_key: "8a314b38790bb302f0fb239dbab1fa2c"
server_key_iv: "4692e23d1082f3f9cf8bb83abd950e22"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:00.212244 31360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "1e565281ed394c9292ae2b613c4b108a"
format_stamp: "Formatted at 2026-08-05 22:39:00 on dist-test-slave-chsk"
server_key: "8a314b38790bb302f0fb239dbab1fa2c"
server_key_iv: "4692e23d1082f3f9cf8bb83abd950e22"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:00.219070 31360 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.000s
I20260805 22:39:00.238050 31375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:00.238252 31360 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260805 22:39:00.238358 31360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "1e565281ed394c9292ae2b613c4b108a"
format_stamp: "Formatted at 2026-08-05 22:39:00 on dist-test-slave-chsk"
server_key: "8a314b38790bb302f0fb239dbab1fa2c"
server_key_iv: "4692e23d1082f3f9cf8bb83abd950e22"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:00.238471 31360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:00.251253 31360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:00.254077 31360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:00.254308 31360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:00.254658 31360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:39:00.255254 31360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:39:00.255332 31360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:00.255366 31360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:39:00.255404 31360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:00.273799 31360 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:36649
I20260805 22:39:00.273928 31492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:36649 every 8 connection(s)
I20260805 22:39:00.274428 31360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:39:00.281775 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 31360
I20260805 22:39:00.281926 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
Aug 05 22:39:00 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969540, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:00.282155 19766 external_mini_cluster.cc:1428] Setting key a01b611253219928dad109b7909bd006
I20260805 22:39:00.289666 31495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.275461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:51159 (local address 127.19.77.190:38059)
0805 22:39:00.276611 (+ 1150us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:00.276613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:00.276627 (+ 14us) server_negotiation.cc:407] Connection header received
0805 22:39:00.276651 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:00.276652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:00.276662 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:00.276740 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:00.277606 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.278183 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.279405 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.279608 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.279691 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.282496 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:00.282498 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:00.282499 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:00.282507 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:00.287648 (+ 5141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:00.288240 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:00.288241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:00.288242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:00.288316 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:00.288677 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:00.288678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:00.288679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:00.288852 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:00.288906 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:00.289385 (+ 479us) server_negotiation.cc:299] Negotiation successful
0805 22:39:00.289529 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1128,"thread_start_us":76,"threads_started":1}
I20260805 22:39:00.290372 31496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.275406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38059 (local address 127.19.77.129:51159)
0805 22:39:00.275630 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:00.275676 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:00.276454 (+ 778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:00.276843 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:00.276848 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:00.277195 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:00.277495 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.277500 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.278282 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.278283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.279307 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.279310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.279699 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.279700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.279885 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.280601 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:00.280610 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:00.282375 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:00.287743 (+ 5368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:00.287772 (+ 29us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:00.287775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:00.288140 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:00.288392 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:00.288393 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:00.288393 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:00.288579 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:00.288964 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:00.288985 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:00.289202 (+ 217us) client_negotiation.cc:769] Sending connection context
0805 22:39:00.289832 (+ 630us) client_negotiation.cc:240] Negotiation successful
0805 22:39:00.290016 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":138,"threads_started":1}
I20260805 22:39:00.291111 31493 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38059
I20260805 22:39:00.291265 31493 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:00.291476 31493 heartbeater.cc:511] Master 127.19.77.190:38059 requested a full tablet report, sending...
I20260805 22:39:00.292069 31275 ts_manager.cc:194] Registered new tserver with Master: 1e565281ed394c9292ae2b613c4b108a (127.19.77.129:36649)
I20260805 22:39:00.292941 31275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:51159
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:39:00.318436 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:39425/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38059
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:39:00.454972 31501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:00.455314 31501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:00.455360 31501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:00.457265 31501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:00.457387 31501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:00.457525 31501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:39:00.460402 31501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.77.148:39425/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:00.460698 31501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:00.461050 31501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:00.470990 31509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:00.471048 31508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:00.472859 31501 server_base.cc:1034] running on GCE node
W20260805 22:39:00.472872 31511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:00.473292 31501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:00.473627 31501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:00.474812 31501 hybrid_clock.cc:648] HybridClock initialized: now 1785969540474805 us; error 48 us; skew 500 ppm
Aug 05 22:39:00 dist-test-slave-chsk krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969540, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:00.479287 31501 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:39:00.480038 31501 webserver.cc:460] Webserver started at http://127.19.77.130:37375/ using document root <none> and password file <none>
I20260805 22:39:00.480443 31501 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:00.480618 31501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:00.480793 31501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:39:00 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969540, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:00.498673 31501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e"
format_stamp: "Formatted at 2026-08-05 22:39:00 on dist-test-slave-chsk"
server_key: "3e41a037d87372f23b1086dc665965f4"
server_key_iv: "c7c84c8f799b14c5c09d6201b1bd07db"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:00.499600 31501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e"
format_stamp: "Formatted at 2026-08-05 22:39:00 on dist-test-slave-chsk"
server_key: "3e41a037d87372f23b1086dc665965f4"
server_key_iv: "c7c84c8f799b14c5c09d6201b1bd07db"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:00.502269 31501 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260805 22:39:00.521807 31518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:00.522156 31501 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260805 22:39:00.522269 31501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e"
format_stamp: "Formatted at 2026-08-05 22:39:00 on dist-test-slave-chsk"
server_key: "3e41a037d87372f23b1086dc665965f4"
server_key_iv: "c7c84c8f799b14c5c09d6201b1bd07db"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:00.522388 31501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 05 22:39:00 dist-test-slave-chsk krb5kdc[30781](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785969540, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:00.547624 31501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:00.550364 31501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:00.550635 31501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:00.550956 31501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:39:00.551450 31501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:39:00.551549 31501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:00.551623 31501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:39:00.551680 31501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:00.566262 31501 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:39847
I20260805 22:39:00.566792 31501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:39:00.567595 31634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:39847 every 8 connection(s)
I20260805 22:39:00.568332 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 31501
I20260805 22:39:00.568460 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:39:00.568668 19766 external_mini_cluster.cc:1428] Setting key 146b8a1df25958d8113aacf64c734fde
Aug 05 22:39:00 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969540, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:00.580351 31495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.568400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:55635 (local address 127.19.77.190:38059)
0805 22:39:00.568462 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:00.568464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:00.568719 (+ 255us) server_negotiation.cc:407] Connection header received
0805 22:39:00.569620 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:00.569621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:00.569639 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:00.569672 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:00.570680 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.571474 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.573131 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.573414 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.573462 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.576561 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:00.576563 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:00.576564 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:00.576573 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:00.578520 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:00.579129 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:00.579130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:00.579130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:00.579219 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:00.579529 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:00.579530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:00.579530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:00.579681 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:00.579728 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:00.580142 (+ 414us) server_negotiation.cc:299] Negotiation successful
0805 22:39:00.580251 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
I20260805 22:39:00.581161 31637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.568248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38059 (local address 127.19.77.130:55635)
0805 22:39:00.568571 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:00.568617 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:00.569486 (+ 869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:00.569875 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:00.569879 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:00.570187 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:00.570551 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.570558 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.571607 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.571608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.573010 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.573014 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.573565 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.573566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.573736 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.574431 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:00.574443 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:00.576414 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:00.578651 (+ 2237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:00.578663 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:00.578666 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:00.579028 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:00.579302 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:00.579303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:00.579303 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:00.579447 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:00.579778 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:00.579785 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:00.579977 (+ 192us) client_negotiation.cc:769] Sending connection context
0805 22:39:00.580514 (+ 537us) client_negotiation.cc:240] Negotiation successful
0805 22:39:00.580710 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":125,"threads_started":1}
I20260805 22:39:00.581866 31635 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38059
I20260805 22:39:00.581992 31635 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:00.582203 31635 heartbeater.cc:511] Master 127.19.77.190:38059 requested a full tablet report, sending...
I20260805 22:39:00.582762 31275 ts_manager.cc:194] Registered new tserver with Master: ff8dbc8999964a15b7f3849ae8f5fc1e (127.19.77.130:39847)
I20260805 22:39:00.583375 31275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:55635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:39:00.610812 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:39425/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38059
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:39:00.727653 31640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:00.728031 31640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:00.728118 31640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:00.729939 31640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:00.730064 31640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:00.730144 31640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:39:00.732456 31640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.77.148:39425/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:38059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:00.732775 31640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:00.733104 31640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:00.738893 31647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:00.739174 31649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:00.739449 31646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:00.739830 31640 server_base.cc:1034] running on GCE node
I20260805 22:39:00.740046 31640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:00.740334 31640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:00.741513 31640 hybrid_clock.cc:648] HybridClock initialized: now 1785969540741493 us; error 33 us; skew 500 ppm
Aug 05 22:39:00 dist-test-slave-chsk krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969540, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:00.745287 31640 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:39:00.745976 31640 webserver.cc:460] Webserver started at http://127.19.77.131:43673/ using document root <none> and password file <none>
I20260805 22:39:00.746292 31640 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:00.746405 31640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:00.746604 31640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:39:00 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969540, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:00.765121 31640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "430db5b5855144adbf85c97971d56bb2"
format_stamp: "Formatted at 2026-08-05 22:39:00 on dist-test-slave-chsk"
server_key: "865c0f67025e3910530efe58f873ccf1"
server_key_iv: "8d687939198c6728923dba243403684f"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:00.765730 31640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "430db5b5855144adbf85c97971d56bb2"
format_stamp: "Formatted at 2026-08-05 22:39:00 on dist-test-slave-chsk"
server_key: "865c0f67025e3910530efe58f873ccf1"
server_key_iv: "8d687939198c6728923dba243403684f"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:00.772578 31640 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.000s
I20260805 22:39:00.788837 31656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:00.789357 31640 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:39:00.789491 31640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "430db5b5855144adbf85c97971d56bb2"
format_stamp: "Formatted at 2026-08-05 22:39:00 on dist-test-slave-chsk"
server_key: "865c0f67025e3910530efe58f873ccf1"
server_key_iv: "8d687939198c6728923dba243403684f"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:00.789611 31640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:00.835793 31640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:00.838521 31640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:00.838725 31640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:00.839031 31640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:39:00.839514 31640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:39:00.839569 31640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:00.839604 31640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:39:00.839666 31640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:00.850256 31640 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:42111
I20260805 22:39:00.850487 31772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:42111 every 8 connection(s)
I20260805 22:39:00.850855 31640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:39:00.852312 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 31640
I20260805 22:39:00.852437 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:39:00.852645 19766 external_mini_cluster.cc:1428] Setting key ac76254d2874133a7924d472d259e6db
Aug 05 22:39:00 dist-test-slave-chsk krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969540, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:00.870350 31495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.851788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:52667 (local address 127.19.77.190:38059)
0805 22:39:00.851838 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:00.851841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:00.859945 (+ 8104us) server_negotiation.cc:407] Connection header received
0805 22:39:00.860568 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:00.860569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:00.860583 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:00.860644 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:00.861436 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.862219 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.863312 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.863657 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.863748 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.866624 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:00.866625 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:00.866626 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:00.866633 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:00.868348 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:00.868931 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:00.868932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:00.868932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:00.869000 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:00.869499 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:00.869500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:00.869501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:00.869681 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:00.869752 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:00.870152 (+ 400us) server_negotiation.cc:299] Negotiation successful
0805 22:39:00.870247 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:39:00.871434 31774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.851837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:38059 (local address 127.19.77.131:52667)
0805 22:39:00.859768 (+ 7931us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:00.859816 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:00.860449 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:00.860791 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:00.860796 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:00.861041 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:00.861315 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.861322 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.862322 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.862322 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.863210 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.863214 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.863768 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.863769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.863962 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.864686 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:00.864695 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:00.866502 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:00.868465 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:00.868476 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:00.868479 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:00.868824 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:00.869201 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:00.869202 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:00.869202 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:00.869319 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:00.869783 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:00.869790 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:00.869970 (+ 180us) client_negotiation.cc:769] Sending connection context
0805 22:39:00.870787 (+ 817us) client_negotiation.cc:240] Negotiation successful
0805 22:39:00.870980 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7880,"thread_start_us":132,"threads_started":1}
I20260805 22:39:00.872326 31773 heartbeater.cc:347] Connected to a master server at 127.19.77.190:38059
I20260805 22:39:00.872623 31773 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:00.872871 31773 heartbeater.cc:511] Master 127.19.77.190:38059 requested a full tablet report, sending...
I20260805 22:39:00.873306 31275 ts_manager.cc:194] Registered new tserver with Master: 430db5b5855144adbf85c97971d56bb2 (127.19.77.131:42111)
I20260805 22:39:00.873716 31275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:52667
I20260805 22:39:00.875306 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:39:00.884582 31495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.877120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38964 (local address 127.19.77.190:38059)
0805 22:39:00.877264 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:00.877266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:00.877572 (+ 306us) server_negotiation.cc:407] Connection header received
0805 22:39:00.877694 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:00.877695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:00.877706 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:00.877753 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:00.878380 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.878881 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.879757 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.879968 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.880050 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.881409 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:00.881411 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:00.881411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:00.881420 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:00.883250 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:00.883675 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:00.883676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:00.883677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:00.883735 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:00.883946 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:00.883947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:00.883947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:00.884085 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:00.884162 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:00.884387 (+ 225us) server_negotiation.cc:299] Negotiation successful
0805 22:39:00.884470 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:39:00.889498 31275 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38964:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:39:00.891866 31275 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:39:00.900930 31786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.894838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:39847 (local address 127.0.0.1:35538)
0805 22:39:00.895380 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:00.895424 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:00.895692 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:00.896820 (+ 1128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:00.896824 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:00.896827 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:39:00.896911 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.896913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.898180 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.898181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.899491 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.899494 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.900593 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.900594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.900705 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.900720 (+ 15us) client_negotiation.cc:769] Sending connection context
0805 22:39:00.900789 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:39:00.900844 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":155,"threads_started":1}
I20260805 22:39:00.901298 31789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.895171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35538 (local address 127.19.77.130:39847)
0805 22:39:00.896632 (+ 1461us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:00.896636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:00.896646 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:39:00.896688 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:00.896689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:00.896703 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:00.896804 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:39:00.897007 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.898070 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.899623 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.900382 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.900456 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.900554 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:00.901160 (+ 606us) server_negotiation.cc:299] Negotiation successful
0805 22:39:00.901203 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1397,"thread_start_us":153,"threads_started":1}
I20260805 22:39:00.901829 31787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.894848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:36649 (local address 127.0.0.1:52482)
0805 22:39:00.896939 (+ 2091us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:00.896950 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:00.897012 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:00.897197 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:00.897198 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:00.897200 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:39:00.897240 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.897242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.899028 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.899029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.900499 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.900502 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.901608 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.901609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.901673 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.901676 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:39:00.901718 (+ 42us) client_negotiation.cc:240] Negotiation successful
0805 22:39:00.901757 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2066,"thread_start_us":160,"threads_started":1}
I20260805 22:39:00.902181 31791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.895423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52482 (local address 127.19.77.129:36649)
0805 22:39:00.895568 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:00.895574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:00.897069 (+ 1495us) server_negotiation.cc:407] Connection header received
0805 22:39:00.897102 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:00.897104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:00.897116 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:00.897200 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:39:00.897326 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.898879 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.900620 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.901425 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.901490 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.901545 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:00.902054 (+ 509us) server_negotiation.cc:299] Negotiation successful
0805 22:39:00.902100 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":74,"threads_started":1}
I20260805 22:39:00.902179 31559 tablet_service.cc:1467] Processing CreateTablet for tablet 307544a402ca4e41848f14c7b258c1da (DEFAULT_TABLE table=test-table [id=ea44d810238047589a677c7c1c9c815b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:39:00.902580 31559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 307544a402ca4e41848f14c7b258c1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:00.903189 31423 tablet_service.cc:1467] Processing CreateTablet for tablet 307544a402ca4e41848f14c7b258c1da (DEFAULT_TABLE table=test-table [id=ea44d810238047589a677c7c1c9c815b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:39:00.903541 31423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 307544a402ca4e41848f14c7b258c1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:00.906631 31785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.895202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:42111 (local address 127.0.0.1:47234)
0805 22:39:00.897309 (+ 2107us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:00.897320 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:00.897383 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:00.897819 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:00.897820 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:00.897822 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:39:00.897980 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.897983 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.899301 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.899302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.900402 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.900405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.902557 (+ 2152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.902559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.906330 (+ 3771us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.906337 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 22:39:00.906388 (+ 51us) client_negotiation.cc:240] Negotiation successful
0805 22:39:00.906551 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2074,"thread_start_us":98,"threads_started":1}
I20260805 22:39:00.906656 31792 tablet_bootstrap.cc:492] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a: Bootstrap starting.
I20260805 22:39:00.907294 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.895307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47234 (local address 127.19.77.131:42111)
0805 22:39:00.897564 (+ 2257us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:00.897569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:00.897579 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:39:00.897626 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:00.897628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:00.897643 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:00.897720 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:39:00.898074 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.899217 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.900581 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.902370 (+ 1789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.902443 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.907071 (+ 4628us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:00.907107 (+ 36us) server_negotiation.cc:299] Negotiation successful
0805 22:39:00.907183 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2209,"thread_start_us":99,"threads_started":1}
I20260805 22:39:00.907670 31792 tablet_bootstrap.cc:654] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:00.908107 31691 tablet_service.cc:1467] Processing CreateTablet for tablet 307544a402ca4e41848f14c7b258c1da (DEFAULT_TABLE table=test-table [id=ea44d810238047589a677c7c1c9c815b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:39:00.908444 31691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 307544a402ca4e41848f14c7b258c1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:00.911652 31794 tablet_bootstrap.cc:492] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: Bootstrap starting.
I20260805 22:39:00.911696 31792 log.cc:824] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:00.911981 31793 tablet_bootstrap.cc:492] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e: Bootstrap starting.
I20260805 22:39:00.913132 31794 tablet_bootstrap.cc:654] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:00.913157 31793 tablet_bootstrap.cc:654] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:00.913611 31793 log.cc:824] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:00.913637 31794 log.cc:824] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:00.914489 31793 tablet_bootstrap.cc:492] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e: No bootstrap required, opened a new log
I20260805 22:39:00.914494 31792 tablet_bootstrap.cc:492] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a: No bootstrap required, opened a new log
I20260805 22:39:00.914569 31792 ts_tablet_manager.cc:1397] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260805 22:39:00.914569 31793 ts_tablet_manager.cc:1397] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:39:00.916376 31794 tablet_bootstrap.cc:492] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: No bootstrap required, opened a new log
I20260805 22:39:00.916457 31794 ts_tablet_manager.cc:1397] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260805 22:39:00.917250 31793 raft_consensus.cc:348] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 } } peers { permanent_uuid: "1e565281ed394c9292ae2b613c4b108a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36649 } } peers { permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 } }
I20260805 22:39:00.917481 31793 raft_consensus.cc:374] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:00.917532 31793 raft_consensus.cc:729] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff8dbc8999964a15b7f3849ae8f5fc1e, State: Initialized, Role: FOLLOWER
I20260805 22:39:00.917688 31793 consensus_queue.cc:260] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 } } peers { permanent_uuid: "1e565281ed394c9292ae2b613c4b108a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36649 } } peers { permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 } }
I20260805 22:39:00.918156 31793 ts_tablet_manager.cc:1428] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260805 22:39:00.918319 31635 heartbeater.cc:503] Master 127.19.77.190:38059 was elected leader, sending a full tablet report...
I20260805 22:39:00.919445 31794 raft_consensus.cc:348] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 } } peers { permanent_uuid: "1e565281ed394c9292ae2b613c4b108a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36649 } } peers { permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 } }
I20260805 22:39:00.919631 31794 raft_consensus.cc:374] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:00.919670 31794 raft_consensus.cc:729] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 430db5b5855144adbf85c97971d56bb2, State: Initialized, Role: FOLLOWER
I20260805 22:39:00.919803 31794 consensus_queue.cc:260] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 } } peers { permanent_uuid: "1e565281ed394c9292ae2b613c4b108a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36649 } } peers { permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 } }
I20260805 22:39:00.920228 31794 ts_tablet_manager.cc:1428] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260805 22:39:00.920305 31773 heartbeater.cc:503] Master 127.19.77.190:38059 was elected leader, sending a full tablet report...
I20260805 22:39:00.921339 31792 raft_consensus.cc:348] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 } } peers { permanent_uuid: "1e565281ed394c9292ae2b613c4b108a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36649 } } peers { permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 } }
I20260805 22:39:00.921519 31792 raft_consensus.cc:374] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:00.921545 31792 raft_consensus.cc:729] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e565281ed394c9292ae2b613c4b108a, State: Initialized, Role: FOLLOWER
I20260805 22:39:00.921684 31792 consensus_queue.cc:260] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 } } peers { permanent_uuid: "1e565281ed394c9292ae2b613c4b108a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36649 } } peers { permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 } }
I20260805 22:39:00.922004 31792 ts_tablet_manager.cc:1428] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a: Time spent starting tablet: real 0.007s user 0.002s sys 0.002s
I20260805 22:39:00.922091 31493 heartbeater.cc:503] Master 127.19.77.190:38059 was elected leader, sending a full tablet report...
I20260805 22:39:00.949777 31800 raft_consensus.cc:482] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:39:00.949950 31800 raft_consensus.cc:504] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 } } peers { permanent_uuid: "1e565281ed394c9292ae2b613c4b108a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36649 } } peers { permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 } }
I20260805 22:39:00.950362 31800 leader_election.cc:288] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff8dbc8999964a15b7f3849ae8f5fc1e (127.19.77.130:39847), 430db5b5855144adbf85c97971d56bb2 (127.19.77.131:42111)
I20260805 22:39:00.954649 31789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.950841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:51795 (local address 127.19.77.130:39847)
0805 22:39:00.950891 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:00.950893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:00.950906 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:39:00.951016 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:00.951027 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:00.951040 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:00.951072 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:39:00.951343 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.952146 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.953669 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.954213 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.954266 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.954277 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:00.954530 (+ 253us) server_negotiation.cc:299] Negotiation successful
0805 22:39:00.954576 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:39:00.954883 31801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.950577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:39847 (local address 127.19.77.129:51795)
0805 22:39:00.950829 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:00.950843 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:00.950919 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:00.951164 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:00.951166 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:00.951168 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:39:00.951261 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.951263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.952294 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.952295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.953557 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.953560 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.954339 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.954340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.954434 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.954439 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:39:00.954750 (+ 311us) client_negotiation.cc:240] Negotiation successful
0805 22:39:00.954797 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":153,"threads_started":1}
I20260805 22:39:00.955327 31577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "307544a402ca4e41848f14c7b258c1da" candidate_uuid: "1e565281ed394c9292ae2b613c4b108a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" is_pre_election: true
I20260805 22:39:00.955538 31577 raft_consensus.cc:2454] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e565281ed394c9292ae2b613c4b108a in term 0.
I20260805 22:39:00.955780 31377 leader_election.cc:302] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e565281ed394c9292ae2b613c4b108a, ff8dbc8999964a15b7f3849ae8f5fc1e; no voters:
I20260805 22:39:00.955909 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.951220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:59603 (local address 127.19.77.131:42111)
0805 22:39:00.951263 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:00.951265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:00.951572 (+ 307us) server_negotiation.cc:407] Connection header received
0805 22:39:00.951676 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:00.951677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:00.951686 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:00.951716 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:39:00.952016 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.952735 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.954141 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.954683 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.954734 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.954742 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:00.955791 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0805 22:39:00.955842 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:39:00.956104 31800 raft_consensus.cc:2781] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:39:00.956180 31800 raft_consensus.cc:482] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:39:00.956230 31800 raft_consensus.cc:3037] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:39:00.956362 31802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.951041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:42111 (local address 127.19.77.129:59603)
0805 22:39:00.951503 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:00.951514 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:00.951599 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:00.951783 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:00.951784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:00.951786 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:39:00.951916 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.951918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.952894 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.952894 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.954029 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:00.954033 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.955217 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.955218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:00.955315 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.955319 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:39:00.956071 (+ 752us) client_negotiation.cc:240] Negotiation successful
0805 22:39:00.956142 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":300,"threads_started":1}
I20260805 22:39:00.956723 31725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "307544a402ca4e41848f14c7b258c1da" candidate_uuid: "1e565281ed394c9292ae2b613c4b108a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "430db5b5855144adbf85c97971d56bb2" is_pre_election: true
I20260805 22:39:00.956912 31725 raft_consensus.cc:2454] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e565281ed394c9292ae2b613c4b108a in term 0.
I20260805 22:39:00.957309 31800 raft_consensus.cc:504] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 } } peers { permanent_uuid: "1e565281ed394c9292ae2b613c4b108a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36649 } } peers { permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 } }
I20260805 22:39:00.957568 31800 leader_election.cc:288] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [CANDIDATE]: Term 1 election: Requested vote from peers ff8dbc8999964a15b7f3849ae8f5fc1e (127.19.77.130:39847), 430db5b5855144adbf85c97971d56bb2 (127.19.77.131:42111)
I20260805 22:39:00.957675 31577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "307544a402ca4e41848f14c7b258c1da" candidate_uuid: "1e565281ed394c9292ae2b613c4b108a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e"
I20260805 22:39:00.957744 31725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "307544a402ca4e41848f14c7b258c1da" candidate_uuid: "1e565281ed394c9292ae2b613c4b108a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "430db5b5855144adbf85c97971d56bb2"
I20260805 22:39:00.957779 31577 raft_consensus.cc:3037] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:39:00.957820 31725 raft_consensus.cc:3037] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:39:00.958859 31577 raft_consensus.cc:2454] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e565281ed394c9292ae2b613c4b108a in term 1.
I20260805 22:39:00.959060 31377 leader_election.cc:302] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e565281ed394c9292ae2b613c4b108a, ff8dbc8999964a15b7f3849ae8f5fc1e; no voters:
I20260805 22:39:00.959336 31800 raft_consensus.cc:2781] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:39:00.959525 31800 raft_consensus.cc:686] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [term 1 LEADER]: Becoming Leader. State: Replica: 1e565281ed394c9292ae2b613c4b108a, State: Running, Role: LEADER
I20260805 22:39:00.959560 31725 raft_consensus.cc:2454] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e565281ed394c9292ae2b613c4b108a in term 1.
I20260805 22:39:00.959638 31800 consensus_queue.cc:237] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 } } peers { permanent_uuid: "1e565281ed394c9292ae2b613c4b108a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36649 } } peers { permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 } }
I20260805 22:39:00.960652 31274 catalog_manager.cc:5495] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e565281ed394c9292ae2b613c4b108a (127.19.77.129). New cstate: current_term: 1 leader_uuid: "1e565281ed394c9292ae2b613c4b108a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e565281ed394c9292ae2b613c4b108a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260805 22:39:00.977679 31791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:00.974037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52488 (local address 127.19.77.129:36649)
0805 22:39:00.974116 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:00.974119 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:00.974129 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:39:00.974174 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:00.974175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:00.974196 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:00.974280 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:39:00.974583 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.975359 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.976497 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:00.976824 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:00.976903 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:00.977139 (+ 236us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:39:00.977297 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:39:00.977387 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:00.977555 (+ 168us) server_negotiation.cc:299] Negotiation successful
0805 22:39:00.977580 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260805 22:39:00.980408 31725 raft_consensus.cc:1261] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2 [term 1 FOLLOWER]: Refusing update from remote peer 1e565281ed394c9292ae2b613c4b108a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:39:00.980822 31800 consensus_queue.cc:1035] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [LEADER]: Connected to new peer: Peer: permanent_uuid: "430db5b5855144adbf85c97971d56bb2" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:39:00.983594 31577 raft_consensus.cc:1261] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e [term 1 FOLLOWER]: Refusing update from remote peer 1e565281ed394c9292ae2b613c4b108a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:39:00.984014 31800 consensus_queue.cc:1035] T 307544a402ca4e41848f14c7b258c1da P 1e565281ed394c9292ae2b613c4b108a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff8dbc8999964a15b7f3849ae8f5fc1e" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:39:00.986487 31807 mvcc.cc:205] Tried to move back new op lower bound from 7315331239852535808 to 7315331239771426816. Current Snapshot: MvccSnapshot[applied={T|T < 7315331239852535808}]
I20260805 22:39:00.987200 31806 mvcc.cc:205] Tried to move back new op lower bound from 7315331239852535808 to 7315331239771426816. Current Snapshot: MvccSnapshot[applied={T|T < 7315331239852535808}]
I20260805 22:39:00.991212 31274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38964:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:39:00.991304 31274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38964:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:39:00.992316 31274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b0c2af028ef4c958e055376b2ace4d7: Sending DeleteTablet for 3 replicas of tablet 307544a402ca4e41848f14c7b258c1da
I20260805 22:39:00.992802 31559 tablet_service.cc:1514] Processing DeleteTablet for tablet 307544a402ca4e41848f14c7b258c1da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:39:00 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:35538
I20260805 22:39:00.993170 31691 tablet_service.cc:1514] Processing DeleteTablet for tablet 307544a402ca4e41848f14c7b258c1da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:39:00 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:47234
I20260805 22:39:00.993887 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 31360
I20260805 22:39:01.004110 31809 mvcc.cc:205] Tried to move back new op lower bound from 7315331239852535808 to 7315331239771426816. Current Snapshot: MvccSnapshot[applied={T|T < 7315331239852535808}]
I20260805 22:39:01.004360 31816 tablet_replica.cc:330] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: stopping tablet replica
I20260805 22:39:01.004498 31816 raft_consensus.cc:2229] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:39:01.004649 31816 raft_consensus.cc:2258] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:39:01.005323 31815 tablet_replica.cc:330] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e: stopping tablet replica
I20260805 22:39:01.005321 31816 ts_tablet_manager.cc:1905] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:39:01.005494 31815 raft_consensus.cc:2229] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:39:01.005709 31815 raft_consensus.cc:2258] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:39:01.007262 31815 ts_tablet_manager.cc:1905] T 307544a402ca4e41848f14c7b258c1da P ff8dbc8999964a15b7f3849ae8f5fc1e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260805 22:39:01.007467 31261 connection.cc:535] client connection to 127.19.77.129:36649 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260805 22:39:01.007588 31261 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 22:39:01.007761 31816 ts_tablet_manager.cc:1918] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:39:01.007829 31816 log.cc:1196] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/307544a402ca4e41848f14c7b258c1da
I20260805 22:39:01.008464 31816 ts_tablet_manager.cc:1939] T 307544a402ca4e41848f14c7b258c1da P 430db5b5855144adbf85c97971d56bb2: Deleting consensus metadata
I20260805 22:39:01.008976 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 31501
I20260805 22:39:01.008971 31261 catalog_manager.cc:4841] TS 430db5b5855144adbf85c97971d56bb2 (127.19.77.131:42111): tablet 307544a402ca4e41848f14c7b258c1da (table test-table [id=ea44d810238047589a677c7c1c9c815b]) successfully deleted
I20260805 22:39:01.011373 31785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:01.011226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:36649 (local address 127.0.0.1:52492)
0805 22:39:01.011283 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:01.011323 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:36649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260805 22:39:01.011554 31261 catalog_manager.cc:4584] TS 1e565281ed394c9292ae2b613c4b108a (127.19.77.129:36649): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 307544a402ca4e41848f14c7b258c1da: Network error: Client connection negotiation failed: client connection to 127.19.77.129:36649: connect: Connection refused (error 111)
I20260805 22:39:01.015528 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 31640
I20260805 22:39:01.015592 31785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:01.015466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:39847 (local address 127.0.0.1:35554)
0805 22:39:01.015519 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:01.015556 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.130:39847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260805 22:39:01.021870 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 31242
I20260805 22:39:01.040023 19766 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260805 22:39:01.384899 19766 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260805 22:39:01.385013 19766 mini_ranger.cc:66] Stopping Ranger...
I20260805 22:39:01.730119 19766 mini_ranger.cc:68] Stopped Ranger
2026-08-05 22:39:01.730 UTC [30812] LOG: received smart shutdown request
2026-08-05 22:39:01.736 UTC [30812] LOG: background worker "logical replication launcher" (PID 30822) exited with exit code 1
2026-08-05 22:39:01.736 UTC [30816] LOG: shutting down
2026-08-05 22:39:01.910 UTC [30812] LOG: database system is shut down
2026-08-05T22:39:01Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53537 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:39:02 dist-test-slave-chsk krb5kdc[31827](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:39:02 dist-test-slave-chsk krb5kdc[31827](info): set up 2 sockets
Aug 05 22:39:02 dist-test-slave-chsk krb5kdc[31827](info): commencing operation
krb5kdc: starting...
W20260805 22:39:03.082046 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:39:03 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:39:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:39:03Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.77.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.77.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/rangeradmin_127.19.77.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/rangeradmin_127.19.77.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.77.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.77.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/rangerlookup_127.19.77.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/rangerlookup_127.19.77.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.77.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.77.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/HTTP_127.19.77.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/HTTP_127.19.77.148@KRBTEST.COM.keytab.
I20260805 22:39:03.272073 19766 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskDgpMZH/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/postgres -l logfile start
2026-08-05 22:39:05.964 UTC [31859] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-05 22:39:05.964 UTC [31859] LOG: listening on IPv4 address "127.19.77.148", port 42189
2026-08-05 22:39:05.968 UTC [31859] LOG: listening on Unix socket "/tmp/.s.PGSQL.42189"
2026-08-05 22:39:06.002 UTC [31862] LOG: database system was shut down at 2026-08-05 22:39:04 UTC
2026-08-05 22:39:06.006 UTC [31859] LOG: database system is ready to accept connections
I20260805 22:39:06.974447 19766 mini_postgres.cc:96] Postgres bound to 42189
2026-08-05 22:39:06.981 UTC [31870] FATAL: database "slave" does not exist
127.19.77.148:42189 - accepting connections
I20260805 22:39:06.982261 19766 mini_ranger.cc:161] Starting Ranger...
I20260805 22:39:06.998843 19766 mini_ranger.cc:84] Created miniranger Postgres user
I20260805 22:39:07.481052 19766 mini_ranger.cc:87] Created ranger Postgres database
I20260805 22:39:07.481148 19766 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-admin
2026-08-05 22:39:07,738 [I] DB FLAVOR :POSTGRES
2026-08-05 22:39:07,738 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:39:07,738 [I] Checking connection..
2026-08-05 22:39:07,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-05 22:39:08,011 [I] Checking connection passed.
2026-08-05 22:39:08,012 [I] --------- Verifying version history table ---------
2026-08-05 22:39:08,012 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:39:08,275 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:39:08,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:39:08,552 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:39:08,552 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-05 22:39:08,552 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-05 22:39:08.817 UTC [31937] WARNING: there is no transaction in progress
2026-08-05 22:39:08,825 [I] create_dbversion_catalog.sql file imported successfully
2026-08-05 22:39:08,826 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:39:09,085 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-05 22:39:09,086 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:39:09,086 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-05 22:39:09,348 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-05 22:39:09,629 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-chsk.c.gcp-upstream.internal','N') ;"
2026-08-05 22:39:09,902 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:39:10,177 [I] Table x_portal_user does not exist in database ranger
2026-08-05 22:39:10,178 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:39:10,449 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-05 22:39:10,449 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:39:10,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:39:10,989 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-05 22:39:10,989 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-05 22:39:12.396 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.424 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.453 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.479 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.507 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.541 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.633 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.644 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.667 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.685 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.703 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.725 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.741 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.753 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.763 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:12.773 UTC [32048] WARNING: there is no transaction in progress
2026-08-05 22:39:13,927 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-05 22:39:13,928 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-05 22:39:14,418 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-05 22:39:14,419 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:39:14,873 [I] Table x_portal_user already exists in database 'ranger'
2026-08-05 22:39:14,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:39:15,261 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-05 22:39:15,261 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:39:15,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:39:15,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-chsk.c.gcp-upstream.internal';"
2026-08-05 22:39:16,046 [I] CORE_DB_SCHEMA import status has been updated
2026-08-05 22:39:16,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-05 22:39:16,321 [I] DB_PATCHES have already been applied
I20260805 22:39:16.327795 19766 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-admin:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskDgpMZH/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260805 22:39:16.327900 19766 mini_ranger.cc:193] Using host: 127.19.77.148
I20260805 22:39:16.332221 19766 mini_ranger.cc:227] Ranger admin URL: http://127.19.77.148:54805
Aug 05, 2026 10:39:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:39:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:39:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-admin/ews/webapp
Aug 05, 2026 10:39:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 05, 2026 10:39:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 05, 2026 10:39:17 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-admin/ews/webapp].
Aug 05, 2026 10:39:17 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260805 22:39:17.458144 19766 mini_ranger.cc:160] Time spent starting Ranger: real 10.476s user 0.000s sys 0.012s
Aug 05, 2026 10:39:38 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 05, 2026 10:39:38 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Aug 05, 2026 10:39:38 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 05, 2026 10:39:38 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 05, 2026 10:39:39 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260805 22:39:40.338959 19766 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.77.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.77.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/rangerkms_127.19.77.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.77.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/rangerkms_127.19.77.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.77.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.77.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.77.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/HTTP_127.19.77.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.77.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/HTTP_127.19.77.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 05 22:39:40 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969580, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260805 22:39:40.434468 19766 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260805 22:39:40.446323 19766 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260805 22:39:41.417105 19766 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260805 22:39:41.417217 19766 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-kms
I20260805 22:39:41.417239 19766 mini_ranger_kms.cc:227] Using postgres at 127.19.77.148:42189
2026-08-05 22:39:41,666 [I] DB FLAVOR :POSTGRES
2026-08-05 22:39:41,666 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:39:41,666 [I] Checking connection
2026-08-05 22:39:41,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-05 22:39:41,987 [I] connection success
2026-08-05 22:39:41,987 [I] --------- Verifying Ranger DB tables ---------
2026-08-05 22:39:41,987 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-05 22:39:41,987 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-05 22:39:42,255 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-05 22:39:42,256 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:39:42,256 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-05 22:39:42,256 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.77.148:42189/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-05 22:39:42,540 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260805 22:39:43.125931 19766 mini_ranger_kms.cc:310] Created kms service
I20260805 22:39:43.363672 19766 mini_ranger_kms.cc:326] Created kudu user
I20260805 22:39:43.412470 19766 mini_ranger_kms.cc:343] Created rangerkms user
Aug 05 22:39:43 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969580, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:43.848234 19766 mini_ranger_kms.cc:384] Added ranger policy
I20260805 22:39:43.848480 19766 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-kms:/tmp/dist-test-taskDgpMZH/build/release/bin/postgresql.jar:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskDgpMZH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260805 22:39:43.848506 19766 mini_ranger_kms.cc:240] Using host: 127.19.77.148
I20260805 22:39:43.853230 19766 mini_ranger_kms.cc:276] Ranger KMS PID: 32234
I20260805 22:39:43.853339 19766 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.77.148:60049
Aug 05, 2026 10:39:45 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:39:45 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:39:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 05, 2026 10:39:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 05, 2026 10:39:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-kms/ews/webapp].
Aug 05, 2026 10:39:45 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260805 22:39:46.188284 19766 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.754s user 0.000s sys 0.227s
I20260805 22:39:46.188411 19766 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260805 22:39:46.188493 19766 mini_ranger_kms.cc:401] 127.19.77.148:60049/kms/v1/keys
Aug 05 22:39:46 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785969586, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.77.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 05 22:39:46 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969586, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.77.148@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
Aug 05 22:39:47 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969586, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.77.148@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
Aug 05 22:39:49 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:39:49.803905 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43577
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:43577
--ranger_config_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:60049/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:39:49.908950 32287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:49.909216 32287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:49.909240 32287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:49.910465 32287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:39:49.910511 32287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:49.910526 32287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:49.910538 32287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:39:49.910550 32287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:39:49.912395 32287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.77.148:60049/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:43577
--ranger_config_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:49.912640 32287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:49.912853 32287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:49.918530 32293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:49.918545 32292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:49.918578 32287 server_base.cc:1034] running on GCE node
W20260805 22:39:49.918530 32295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:49.919221 32287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:49.919534 32287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:49.920710 32287 hybrid_clock.cc:648] HybridClock initialized: now 1785969589920695 us; error 35 us; skew 500 ppm
Aug 05 22:39:49 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969589, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:49.923679 32287 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:39:49.924191 32287 webserver.cc:460] Webserver started at http://127.19.77.190:45743/ using document root <none> and password file <none>
I20260805 22:39:49.924443 32287 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:49.924510 32287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:49.924682 32287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:39:49 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969589, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:49.993948 32287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "1909bc4de49e4c4db974eb95ba27a326"
format_stamp: "Formatted at 2026-08-05 22:39:49 on dist-test-slave-chsk"
server_key: "d0a5aa21f71ac4a0e25fee14d3e81b5a"
server_key_iv: "4cdd1d456f5fe7750b62b7b5124452e8"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:49.994477 32287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "1909bc4de49e4c4db974eb95ba27a326"
format_stamp: "Formatted at 2026-08-05 22:39:49 on dist-test-slave-chsk"
server_key: "d0a5aa21f71ac4a0e25fee14d3e81b5a"
server_key_iv: "4cdd1d456f5fe7750b62b7b5124452e8"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:49.996577 32287 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260805 22:39:50.012756 32302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:50.012951 32287 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:39:50.013064 32287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "1909bc4de49e4c4db974eb95ba27a326"
format_stamp: "Formatted at 2026-08-05 22:39:49 on dist-test-slave-chsk"
server_key: "d0a5aa21f71ac4a0e25fee14d3e81b5a"
server_key_iv: "4cdd1d456f5fe7750b62b7b5124452e8"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:50.013162 32287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:50.025863 32287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:50.028141 32287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:50.028343 32287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:50.033185 32287 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:43577
I20260805 22:39:50.033414 32354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:43577 every 8 connection(s)
I20260805 22:39:50.033668 32287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:39:50.034475 32355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:50.036972 32355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: Bootstrap starting.
I20260805 22:39:50.037585 32355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:50.037838 32355 log.cc:824] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:50.038652 32355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: No bootstrap required, opened a new log
I20260805 22:39:50.040941 32355 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } }
I20260805 22:39:50.041122 32355 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:50.041146 32355 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1909bc4de49e4c4db974eb95ba27a326, State: Initialized, Role: FOLLOWER
I20260805 22:39:50.041304 32355 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } }
I20260805 22:39:50.041391 32355 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:39:50.041416 32355 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:39:50.041445 32355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:39:50.042096 32355 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } }
I20260805 22:39:50.042192 32355 leader_election.cc:302] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1909bc4de49e4c4db974eb95ba27a326; no voters:
I20260805 22:39:50.042348 32355 leader_election.cc:288] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:39:50.042415 32358 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:39:50.042654 32358 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 1 LEADER]: Becoming Leader. State: Replica: 1909bc4de49e4c4db974eb95ba27a326, State: Running, Role: LEADER
I20260805 22:39:50.042675 32355 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:39:50.042759 32358 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } }
I20260805 22:39:50.043238 32360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1909bc4de49e4c4db974eb95ba27a326. Latest consensus state: current_term: 1 leader_uuid: "1909bc4de49e4c4db974eb95ba27a326" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } } }
I20260805 22:39:50.043238 32359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1909bc4de49e4c4db974eb95ba27a326" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } } }
I20260805 22:39:50.043366 32360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [sys.catalog]: This master's current role is: LEADER
I20260805 22:39:50.043448 32359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [sys.catalog]: This master's current role is: LEADER
I20260805 22:39:50.043651 32366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:39:50.043679 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 32287
I20260805 22:39:50.043783 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:39:50.043989 19766 external_mini_cluster.cc:1428] Setting key fa8f800bdd30ee8ac875c43ef9c23170
I20260805 22:39:50.044658 32366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:39:50.045333 32355 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 22:39:50.049899 32366 catalog_manager.cc:1347] Generated new cluster ID: e02aca2e89e44f27a7ae9c6180848a76
I20260805 22:39:50.050009 32366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:39:50 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:50.059680 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:50.044540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36680 (local address 127.19.77.190:43577)
0805 22:39:50.044736 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:50.044747 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:50.045595 (+ 848us) server_negotiation.cc:407] Connection header received
0805 22:39:50.045874 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:50.045882 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:50.045950 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:50.046127 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:50.048341 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:50.050466 (+ 2125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:50.051648 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:50.052334 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:50.052417 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:50.055583 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:50.055590 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:50.055590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:50.055606 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:50.057787 (+ 2181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:50.058251 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:50.058255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:50.058255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:50.058369 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:50.058543 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:50.058544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:50.058544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:50.058872 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:50.058997 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:50.059283 (+ 286us) server_negotiation.cc:299] Negotiation successful
0805 22:39:50.059431 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":73,"threads_started":1}
I20260805 22:39:50.063314 32366 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:39:50.063915 32366 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:39:50.077931 32366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: Generated new TSK 0
I20260805 22:39:50.078171 32366 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:39:50.894322 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:60049/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43577
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:39:51.002184 32401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:51.002763 32401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:51.002811 32401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:51.005363 32401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:51.005463 32401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:51.005519 32401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:39:51.007753 32401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.77.148:60049/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:51.008085 32401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:51.008358 32401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:51.014302 32406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:51.014343 32401 server_base.cc:1034] running on GCE node
W20260805 22:39:51.014444 32407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:51.014302 32409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:51.014844 32401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:51.015223 32401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:51.016422 32401 hybrid_clock.cc:648] HybridClock initialized: now 1785969591016398 us; error 44 us; skew 500 ppm
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:51.020172 32401 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:39:51.020809 32401 webserver.cc:460] Webserver started at http://127.19.77.129:42009/ using document root <none> and password file <none>
I20260805 22:39:51.021093 32401 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:51.021157 32401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:51.021389 32401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:51.039913 32401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "6b5522dc730d49688fe406fc50ed506c"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "094d310326536b4b9326a8a7f61ea406"
server_key_iv: "d6f52ddb590c9aaf2bf30a4d38feff3b"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:51.040557 32401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "6b5522dc730d49688fe406fc50ed506c"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "094d310326536b4b9326a8a7f61ea406"
server_key_iv: "d6f52ddb590c9aaf2bf30a4d38feff3b"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:51.042865 32401 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260805 22:39:51.062920 32417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:51.063179 32401 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 22:39:51.063287 32401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "6b5522dc730d49688fe406fc50ed506c"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "094d310326536b4b9326a8a7f61ea406"
server_key_iv: "d6f52ddb590c9aaf2bf30a4d38feff3b"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:51.063406 32401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:51.076563 32401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:51.079079 32401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:51.079344 32401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:51.079629 32401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:39:51.080068 32401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:39:51.080137 32401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:51.080205 32401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:39:51.080240 32401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:51.088424 32401 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:38015
I20260805 22:39:51.088500 32533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:38015 every 8 connection(s)
I20260805 22:39:51.088997 32401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:39:51.093406 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 32401
I20260805 22:39:51.093552 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:39:51.093752 19766 external_mini_cluster.cc:1428] Setting key 23671b290c794161b90c828ddc348e2c
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:51.106216 32536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:51.089952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43577 (local address 127.19.77.129:46057)
0805 22:39:51.090195 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:51.090252 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:51.090966 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:51.091446 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:51.091451 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:51.091726 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:51.092019 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:51.092025 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.093149 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.093150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:51.094515 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:51.094519 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.095061 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.095062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:51.095277 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:51.095947 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:51.095959 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:51.097514 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:51.104105 (+ 6591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:51.104123 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:51.104127 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:51.104543 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:51.104832 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:51.104833 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:51.104833 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:51.105011 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:51.105380 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:51.105388 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:51.105586 (+ 198us) client_negotiation.cc:769] Sending connection context
0805 22:39:51.105694 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 22:39:51.105889 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:39:51.107278 32537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:51.090310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:46057 (local address 127.19.77.190:43577)
0805 22:39:51.091206 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:51.091209 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:51.091218 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:39:51.091246 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:51.091247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:51.091261 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:51.091333 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:51.092161 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.093020 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.094619 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.094925 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.095015 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:51.097643 (+ 2628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:51.097645 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:51.097645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:51.097654 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:51.103937 (+ 6283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:51.104666 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:51.104668 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:51.104668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:51.104751 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:51.105102 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:51.105104 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:51.105104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:51.105290 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:51.106914 (+ 1624us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:51.106980 (+ 66us) server_negotiation.cc:299] Negotiation successful
0805 22:39:51.107103 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":868,"thread_start_us":66,"threads_started":1}
I20260805 22:39:51.107816 32534 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43577
I20260805 22:39:51.107955 32534 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:51.108242 32534 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
I20260805 22:39:51.108896 32319 ts_manager.cc:194] Registered new tserver with Master: 6b5522dc730d49688fe406fc50ed506c (127.19.77.129:38015)
I20260805 22:39:51.109746 32319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:46057
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:39:51.130623 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:60049/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43577
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:39:51.245714 32540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:51.245981 32540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:51.246024 32540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:51.247491 32540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:51.247574 32540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:51.247624 32540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:39:51.249332 32540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.77.148:60049/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:51.249670 32540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:51.249949 32540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:51.256142 32550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:51.256525 32547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:51.257264 32548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:51.257555 32540 server_base.cc:1034] running on GCE node
I20260805 22:39:51.257880 32540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:51.258220 32540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:51.259387 32540 hybrid_clock.cc:648] HybridClock initialized: now 1785969591259364 us; error 38 us; skew 500 ppm
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:51.262367 32540 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:39:51.262866 32540 webserver.cc:460] Webserver started at http://127.19.77.130:39433/ using document root <none> and password file <none>
I20260805 22:39:51.263200 32540 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:51.263289 32540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:51.263446 32540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:51.278926 32540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "97851682e0dd22876cb6a1e599304cee"
server_key_iv: "4ab5d109e426f56b3737380f95b7dfec"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:51.279536 32540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "97851682e0dd22876cb6a1e599304cee"
server_key_iv: "4ab5d109e426f56b3737380f95b7dfec"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:51.281610 32540 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:51.304208 32557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:51.304512 32540 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260805 22:39:51.304630 32540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "97851682e0dd22876cb6a1e599304cee"
server_key_iv: "4ab5d109e426f56b3737380f95b7dfec"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:51.304734 32540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:51.359886 32540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:51.363088 32540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:51.363384 32540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:51.363659 32540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:39:51.364095 32540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:39:51.364182 32540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:51.364256 32540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:39:51.364316 32540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:51.373068 32540 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:44545
I20260805 22:39:51.373639 32540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:39:51.374439 32675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:44545 every 8 connection(s)
I20260805 22:39:51.379223 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 32540
I20260805 22:39:51.379339 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:39:51.379554 19766 external_mini_cluster.cc:1428] Setting key bdaf3ca8caf708ad469c8bcfb31a66c4
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:51.386512 32678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:51.374567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43577 (local address 127.19.77.130:49319)
0805 22:39:51.374871 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:51.374917 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:51.375660 (+ 743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:51.376050 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:51.376054 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:51.376333 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:51.376623 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:51.376628 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.377709 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.377710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:51.379016 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:51.379019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.379660 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.379660 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:51.379836 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:51.380531 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:51.380543 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:51.382343 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:51.384489 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:51.384501 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:51.384504 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:51.384900 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:51.385157 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:51.385159 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:51.385159 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:51.385331 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:51.385673 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:51.385694 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:51.385912 (+ 218us) client_negotiation.cc:769] Sending connection context
0805 22:39:51.386039 (+ 127us) client_negotiation.cc:240] Negotiation successful
0805 22:39:51.386239 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":114,"threads_started":1}
I20260805 22:39:51.387383 32537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:51.374780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:49319 (local address 127.19.77.190:43577)
0805 22:39:51.374830 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:51.374832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:51.375008 (+ 176us) server_negotiation.cc:407] Connection header received
0805 22:39:51.375802 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:51.375804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:51.375823 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:51.375855 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:51.376751 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.377573 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.379131 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.379498 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.379544 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:51.382489 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:51.382492 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:51.382492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:51.382502 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:51.384362 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:51.385006 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:51.385008 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:51.385008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:51.385078 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:51.385416 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:51.385417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:51.385417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:51.385572 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:51.385642 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:51.387134 (+ 1492us) server_negotiation.cc:299] Negotiation successful
0805 22:39:51.387277 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:39:51.395248 32676 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43577
I20260805 22:39:51.395506 32676 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:51.395833 32676 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
I20260805 22:39:51.396574 32319 ts_manager.cc:194] Registered new tserver with Master: ccf4ec9f238a43cd8c38ce4a17d76f4f (127.19.77.130:44545)
I20260805 22:39:51.397096 32319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:49319
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:39:51.424678 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:60049/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43577
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:39:51.569725 32682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:51.570123 32682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:51.570211 32682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:51.572193 32682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:51.572342 32682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:51.572435 32682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:39:51.574879 32682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.77.148:60049/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:43577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:51.575201 32682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:51.575531 32682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:51.582726 32690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:51.583061 32688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:51.584075 32687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:51.585135 32682 server_base.cc:1034] running on GCE node
I20260805 22:39:51.585444 32682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:51.585800 32682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:51.598974 32682 hybrid_clock.cc:648] HybridClock initialized: now 1785969591598924 us; error 68 us; skew 500 ppm
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:51.603224 32682 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:39:51.603904 32682 webserver.cc:460] Webserver started at http://127.19.77.131:37509/ using document root <none> and password file <none>
I20260805 22:39:51.604240 32682 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:51.604328 32682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:51.604491 32682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:51.622983 32682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "c515c5afe34f4c958c06cd38ad0167fa"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "a5de99f1f55ede718ee978fbd714bf95"
server_key_iv: "c10cfd3cef5b6bef4f301c704dec0b59"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:51.623634 32682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "c515c5afe34f4c958c06cd38ad0167fa"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "a5de99f1f55ede718ee978fbd714bf95"
server_key_iv: "c10cfd3cef5b6bef4f301c704dec0b59"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:51.631769 32682 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.001s sys 0.000s
I20260805 22:39:51.646917 32697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:51.647229 32682 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:39:51.647353 32682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "c515c5afe34f4c958c06cd38ad0167fa"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "a5de99f1f55ede718ee978fbd714bf95"
server_key_iv: "c10cfd3cef5b6bef4f301c704dec0b59"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:51.647461 32682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:51.686578 32682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:51.689239 32682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:51.689471 32682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:51.689795 32682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:39:51.690229 32682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:39:51.690315 32682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:51.690485 32682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:39:51.690544 32682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:51.709420 32682 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:45389
I20260805 22:39:51.710004 32682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:39:51.710593 346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:45389 every 8 connection(s)
I20260805 22:39:51.711540 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 32682
I20260805 22:39:51.711651 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:39:51.711858 19766 external_mini_cluster.cc:1428] Setting key 8ff4b3dbdf74f45ba4c352d1fd3e95bf
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:51.725608 32537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:51.712336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:60985 (local address 127.19.77.190:43577)
0805 22:39:51.712495 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:51.712498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:51.713486 (+ 988us) server_negotiation.cc:407] Connection header received
0805 22:39:51.714199 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:51.714200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:51.714214 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:51.714244 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:51.715098 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.715898 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.717629 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.717928 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.717970 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:51.720777 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:51.720779 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:51.720779 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:51.720788 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:51.723350 (+ 2562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:51.724506 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:51.724507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:51.724507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:51.724584 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:51.724867 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:51.724868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:51.724868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:51.725003 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:51.725045 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:51.725417 (+ 372us) server_negotiation.cc:299] Negotiation successful
0805 22:39:51.725509 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260805 22:39:51.726626 349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:51.711607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43577 (local address 127.19.77.131:60985)
0805 22:39:51.713185 (+ 1578us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:51.713235 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:51.714078 (+ 843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:51.714430 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:51.714435 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:51.714701 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:51.714976 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:51.714982 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.716069 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.716070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:51.717528 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:51.717531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:51.718094 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:51.718095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:51.718227 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:51.718878 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:51.718889 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:51.720658 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:51.724057 (+ 3399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:51.724067 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:51.724070 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:51.724410 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:51.724660 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:51.724661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:51.724661 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:51.724798 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:51.725091 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:51.725097 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:51.725268 (+ 171us) client_negotiation.cc:769] Sending connection context
0805 22:39:51.726146 (+ 878us) client_negotiation.cc:240] Negotiation successful
0805 22:39:51.726332 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1533,"thread_start_us":358,"threads_started":1}
I20260805 22:39:51.727470 347 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43577
I20260805 22:39:51.727573 347 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:51.727769 347 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
I20260805 22:39:51.728196 32319 ts_manager.cc:194] Registered new tserver with Master: c515c5afe34f4c958c06cd38ad0167fa (127.19.77.131:45389)
I20260805 22:39:51.728734 32319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:60985
I20260805 22:39:51.735178 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:39:51.737146 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 32401
I20260805 22:39:51.748060 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 32540
I20260805 22:39:51.757606 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 32682
I20260805 22:39:51.767025 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 32287
I20260805 22:39:51.775321 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43577
--webserver_interface=127.19.77.190
--webserver_port=45743
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:43577
--ranger_config_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:60049/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.77.148:60049/kms with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:39:51.867213 350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:51.867486 350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:51.867513 350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:51.868784 350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:39:51.868835 350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:51.868849 350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:51.868861 350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:39:51.868875 350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:39:51.870661 350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.77.148:60049/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:43577
--ranger_config_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=45743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:51.870918 350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:51.871248 350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:51.876552 355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:51.876785 350 server_base.cc:1034] running on GCE node
W20260805 22:39:51.876569 358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:51.876550 356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:51.877157 350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:51.877547 350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:51.878746 350 hybrid_clock.cc:648] HybridClock initialized: now 1785969591878739 us; error 45 us; skew 500 ppm
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:51.881830 350 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:39:51.882395 350 webserver.cc:460] Webserver started at http://127.19.77.190:45743/ using document root <none> and password file <none>
I20260805 22:39:51.882609 350 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:51.882668 350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:39:51 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969591, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:51.924744 350 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:39:51.925699 366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:51.926007 350 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:39:51.926154 350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "1909bc4de49e4c4db974eb95ba27a326"
format_stamp: "Formatted at 2026-08-05 22:39:49 on dist-test-slave-chsk"
server_key: "d0a5aa21f71ac4a0e25fee14d3e81b5a"
server_key_iv: "4cdd1d456f5fe7750b62b7b5124452e8"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:51.926568 350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:51.940696 350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:51.942945 350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:51.943094 350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:51.947476 350 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:43577
I20260805 22:39:51.947521 419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:43577 every 8 connection(s)
I20260805 22:39:51.947937 350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:39:51.949301 421 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:39:51.950158 421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: Bootstrap starting.
I20260805 22:39:51.952720 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 350
I20260805 22:39:51.953157 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:60049/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:38015
--local_ip_for_outbound_sockets=127.19.77.129
--tserver_master_addrs=127.19.77.190:43577
--webserver_port=42009
--webserver_interface=127.19.77.129
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.77.148:60049/kms with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:39:51.959192 421 log.cc:824] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:51.961275 421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:39:51.961643 421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: Bootstrap complete.
I20260805 22:39:51.964318 421 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } }
I20260805 22:39:51.964618 421 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1909bc4de49e4c4db974eb95ba27a326, State: Initialized, Role: FOLLOWER
I20260805 22:39:51.964841 421 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } }
I20260805 22:39:51.964937 421 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:39:51.964994 421 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:39:51.965052 421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:39:51.966174 421 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } }
I20260805 22:39:51.966310 421 leader_election.cc:302] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1909bc4de49e4c4db974eb95ba27a326; no voters:
I20260805 22:39:51.966557 421 leader_election.cc:288] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:39:51.966596 425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:39:51.966708 425 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [term 2 LEADER]: Becoming Leader. State: Replica: 1909bc4de49e4c4db974eb95ba27a326, State: Running, Role: LEADER
I20260805 22:39:51.966852 421 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:39:51.966876 425 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } }
I20260805 22:39:51.967314 426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1909bc4de49e4c4db974eb95ba27a326" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } } }
I20260805 22:39:51.967396 426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [sys.catalog]: This master's current role is: LEADER
I20260805 22:39:51.967653 427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1909bc4de49e4c4db974eb95ba27a326. Latest consensus state: current_term: 2 leader_uuid: "1909bc4de49e4c4db974eb95ba27a326" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1909bc4de49e4c4db974eb95ba27a326" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43577 } } }
I20260805 22:39:51.967801 427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326 [sys.catalog]: This master's current role is: LEADER
I20260805 22:39:51.968592 421 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 22:39:51.971113 430 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:39:51.972335 430 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:39:51.972697 430 catalog_manager.cc:1259] Loaded cluster ID: e02aca2e89e44f27a7ae9c6180848a76
I20260805 22:39:51.972819 430 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:39:51.975024 430 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:39:51.975373 430 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: Loaded TSK: 0
I20260805 22:39:51.975644 430 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:39:52.074209 423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:52.074635 423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:52.074704 423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:52.076671 423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:52.076774 423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:52.076820 423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:39:52.079525 423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.77.148:60049/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:38015
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=42009
--tserver_master_addrs=127.19.77.190:43577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:52.079843 423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:52.080152 423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:52.087272 460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:52.087729 459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:52.088029 462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:52.088426 423 server_base.cc:1034] running on GCE node
I20260805 22:39:52.088702 423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:52.089130 423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:52.090299 423 hybrid_clock.cc:648] HybridClock initialized: now 1785969592090273 us; error 60 us; skew 500 ppm
Aug 05 22:39:52 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969592, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:52.094051 423 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:39:52.094731 423 webserver.cc:460] Webserver started at http://127.19.77.129:42009/ using document root <none> and password file <none>
I20260805 22:39:52.095072 423 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:52.095254 423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:39:52 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969592, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:52.122310 423 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260805 22:39:52.123690 470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:52.123939 423 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:39:52.124043 423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "6b5522dc730d49688fe406fc50ed506c"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "094d310326536b4b9326a8a7f61ea406"
server_key_iv: "d6f52ddb590c9aaf2bf30a4d38feff3b"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:52.124570 423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:52.139396 423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:52.142184 423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:52.142349 423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:52.142591 423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:39:52.143005 423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:39:52.143061 423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:52.143112 423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:39:52.143177 423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:52.151338 423 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:38015
I20260805 22:39:52.151870 423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:39:52.152734 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 423
I20260805 22:39:52.153059 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:60049/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:44545
--local_ip_for_outbound_sockets=127.19.77.130
--tserver_master_addrs=127.19.77.190:43577
--webserver_port=39433
--webserver_interface=127.19.77.130
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.77.148:60049/kms with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:39:52.163702 586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:38015 every 8 connection(s)
Aug 05 22:39:52 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969592, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:52.188899 590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:52.164521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43577 (local address 127.19.77.129:45341)
0805 22:39:52.167543 (+ 3022us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:52.167615 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:52.168325 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:52.175917 (+ 7592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:52.175922 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:52.176216 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:52.176529 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:52.176536 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.178380 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.178382 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:52.179784 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:52.179789 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.180655 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.180657 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:52.180792 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:52.181459 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:52.181469 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:52.184194 (+ 2725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:52.186782 (+ 2588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:52.186794 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:52.186798 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:52.187204 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:52.187532 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:52.187533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:52.187533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:52.187671 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:52.188195 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:52.188201 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:52.188355 (+ 154us) client_negotiation.cc:769] Sending connection context
0805 22:39:52.188452 (+ 97us) client_negotiation.cc:240] Negotiation successful
0805 22:39:52.188643 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2958,"thread_start_us":123,"threads_started":1}
I20260805 22:39:52.190057 591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:52.165001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:45341 (local address 127.19.77.190:43577)
0805 22:39:52.175288 (+ 10287us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:52.175301 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:52.175360 (+ 59us) server_negotiation.cc:407] Connection header received
0805 22:39:52.175546 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:52.175554 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:52.175625 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:52.176677 (+ 1052us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:52.176757 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.178239 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.179921 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.180531 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.181127 (+ 596us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:52.184370 (+ 3243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:52.184377 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:52.184377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:52.184393 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:52.186637 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:52.187319 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:52.187323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:52.187323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:52.187446 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:52.187759 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:52.187760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:52.187760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:52.188086 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:52.189581 (+ 1495us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:52.189675 (+ 94us) server_negotiation.cc:299] Negotiation successful
0805 22:39:52.189835 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10214,"thread_start_us":104,"threads_started":1}
I20260805 22:39:52.191071 587 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43577
I20260805 22:39:52.191205 587 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:52.191442 587 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
W20260805 22:39:52.192482 587 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:43577 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:39:52.192564 587 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:52.192641 587 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
I20260805 22:39:52.193154 587 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:52.193255 587 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
W20260805 22:39:52.193655 587 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:39:52.278707 589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:52.278998 589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:52.279043 589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:52.280481 589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:52.280563 589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:52.280614 589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:39:52.282553 589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.77.148:60049/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:44545
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=39433
--tserver_master_addrs=127.19.77.190:43577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:52.282866 589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:52.283208 589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:52.288631 597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:52.288631 596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:52.289230 599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:52.289815 589 server_base.cc:1034] running on GCE node
I20260805 22:39:52.290069 589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:52.290373 589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:52.291525 589 hybrid_clock.cc:648] HybridClock initialized: now 1785969592291509 us; error 40 us; skew 500 ppm
Aug 05 22:39:52 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969592, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:52.294795 589 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:39:52.295469 589 webserver.cc:460] Webserver started at http://127.19.77.130:39433/ using document root <none> and password file <none>
I20260805 22:39:52.295773 589 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:52.295861 589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:39:52 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969592, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:52.316190 589 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:39:52.317226 607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:52.317488 589 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:39:52.317590 589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "97851682e0dd22876cb6a1e599304cee"
server_key_iv: "4ab5d109e426f56b3737380f95b7dfec"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:52.317994 589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:52.333250 589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:52.335940 589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:52.336133 589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:52.336427 589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:39:52.336835 589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:39:52.336894 589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:52.336935 589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:39:52.336961 589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:52.344895 589 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:44545
I20260805 22:39:52.344940 721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:44545 every 8 connection(s)
I20260805 22:39:52.345361 589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:39:52.351176 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 589
I20260805 22:39:52.351511 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.77.148:60049/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:45389
--local_ip_for_outbound_sockets=127.19.77.131
--tserver_master_addrs=127.19.77.190:43577
--webserver_port=37509
--webserver_interface=127.19.77.131
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.77.148:60049/kms with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:39:52 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969592, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:52.356245 591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:52.346243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:39611 (local address 127.19.77.190:43577)
0805 22:39:52.346311 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:52.346313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:52.346571 (+ 258us) server_negotiation.cc:407] Connection header received
0805 22:39:52.347068 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:52.347070 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:52.347087 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:52.347205 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:52.347809 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.348612 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.349701 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.349929 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.350008 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:52.352513 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:52.352515 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:52.352515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:52.352523 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:52.354337 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:52.354939 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:52.354939 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:52.354940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:52.354992 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:52.355335 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:52.355337 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:52.355337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:52.355516 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:52.355618 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:52.356006 (+ 388us) server_negotiation.cc:299] Negotiation successful
0805 22:39:52.356132 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:39:52.356429 724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:52.346232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43577 (local address 127.19.77.130:39611)
0805 22:39:52.346412 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:52.346457 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:52.346951 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:52.347289 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:52.347292 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:52.347481 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:52.347696 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:52.347700 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.348722 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.348722 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:52.349597 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:52.349599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.350053 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.350055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:52.350172 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:52.350755 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:52.350763 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:52.352396 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:52.354468 (+ 2072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:52.354478 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:52.354482 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:52.354840 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:52.355062 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:52.355063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:52.355063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:52.355241 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:52.355623 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:52.355630 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:52.355816 (+ 186us) client_negotiation.cc:769] Sending connection context
0805 22:39:52.355941 (+ 125us) client_negotiation.cc:240] Negotiation successful
0805 22:39:52.356131 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":89,"threads_started":1}
I20260805 22:39:52.363754 722 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43577
I20260805 22:39:52.364029 722 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:52.364360 722 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
W20260805 22:39:52.365304 722 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:43577 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:39:52.365391 722 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:52.365468 722 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
I20260805 22:39:52.365777 722 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:52.365851 722 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
W20260805 22:39:52.366093 722 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:39:52.485723 725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:52.486074 725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:52.486126 725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:52.489289 725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:52.489382 725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:52.489440 725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:39:52.492887 725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.77.148:60049/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:45389
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=37509
--tserver_master_addrs=127.19.77.190:43577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:52.493261 725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:52.493592 725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:52.501492 733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:52.501492 730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:52.502204 731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:52.506731 725 server_base.cc:1034] running on GCE node
I20260805 22:39:52.507089 725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:52.507494 725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:52.522992 725 hybrid_clock.cc:648] HybridClock initialized: now 1785969592522940 us; error 94 us; skew 500 ppm
Aug 05 22:39:52 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969592, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:52.526167 725 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:39:52.526770 725 webserver.cc:460] Webserver started at http://127.19.77.131:37509/ using document root <none> and password file <none>
I20260805 22:39:52.527071 725 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:52.527202 725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:39:52 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969592, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:52.543283 725 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260805 22:39:52.546175 742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:52.546386 725 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:39:52.546494 725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "c515c5afe34f4c958c06cd38ad0167fa"
format_stamp: "Formatted at 2026-08-05 22:39:51 on dist-test-slave-chsk"
server_key: "a5de99f1f55ede718ee978fbd714bf95"
server_key_iv: "c10cfd3cef5b6bef4f301c704dec0b59"
server_key_version: "kuduclusterkey@0"
I20260805 22:39:52.547870 725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:52.576683 725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:52.579427 725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:52.579622 725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:52.579910 725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:39:52.580328 725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:39:52.580387 725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:52.580418 725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:39:52.580439 725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:52.590706 725 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:45389
I20260805 22:39:52.591286 725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:39:52.593758 858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:45389 every 8 connection(s)
Aug 05 22:39:52 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969592, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:52.600780 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 725
I20260805 22:39:52.604614 591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:52.594089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:59315 (local address 127.19.77.190:43577)
0805 22:39:52.594192 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:52.594194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:52.594228 (+ 34us) server_negotiation.cc:407] Connection header received
0805 22:39:52.594795 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:52.594796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:52.594810 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:52.594866 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:52.595579 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.596083 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.597752 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.598029 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.598095 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:52.600998 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:52.601001 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:52.601002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:52.601013 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:52.602807 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:52.603401 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:52.603402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:52.603402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:52.603478 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:52.603806 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:52.603807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:52.603808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:52.603947 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:52.604002 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:52.604419 (+ 417us) server_negotiation.cc:299] Negotiation successful
0805 22:39:52.604511 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260805 22:39:52.605098 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:52.593739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:43577 (local address 127.19.77.131:59315)
0805 22:39:52.593942 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:52.593989 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:52.594679 (+ 690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:52.594961 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:52.594966 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:52.595254 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:52.595480 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:52.595485 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.596241 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.596242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:52.597603 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:52.597607 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.598159 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.598160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:52.598322 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:52.598955 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:52.598966 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:52.600780 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:52.602922 (+ 2142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:52.602933 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:52.602936 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:52.603306 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:52.603559 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:52.603560 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:52.603560 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:52.603713 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:52.604039 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:52.604046 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:52.604226 (+ 180us) client_negotiation.cc:769] Sending connection context
0805 22:39:52.604349 (+ 123us) client_negotiation.cc:240] Negotiation successful
0805 22:39:52.604547 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":100,"threads_started":1}
I20260805 22:39:52.605638 859 heartbeater.cc:347] Connected to a master server at 127.19.77.190:43577
I20260805 22:39:52.605768 859 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:52.606278 859 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
W20260805 22:39:52.607046 859 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:43577 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:39:52.607169 859 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:52.607261 859 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
I20260805 22:39:52.607659 859 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:52.607746 859 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
W20260805 22:39:52.608191 859 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:39:52.610895 863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:52.601244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36682 (local address 127.19.77.190:43577)
0805 22:39:52.601803 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:52.601806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:52.601818 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:39:52.602131 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:52.602132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:52.602146 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:52.602235 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:52.603066 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.603845 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.604771 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:52.604991 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:52.605074 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:52.606730 (+ 1656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:52.606731 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:52.606732 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:52.606802 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:52.609231 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:52.609711 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:52.609712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:52.609712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:52.609768 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:52.610081 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:52.610084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:52.610085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:52.610430 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:52.610654 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:52.610697 (+ 43us) server_negotiation.cc:299] Negotiation successful
0805 22:39:52.610799 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":462,"threads_started":1}
Aug 05 22:39:53 dist-test-slave-chsk krb5kdc[31827](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785969593, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:53.193861 587 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:53.194036 587 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
I20260805 22:39:53.194494 383 ts_manager.cc:194] Registered new tserver with Master: 6b5522dc730d49688fe406fc50ed506c (127.19.77.129:38015)
I20260805 22:39:53.195698 383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:45341
I20260805 22:39:53.366304 722 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:53.366490 722 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
I20260805 22:39:53.366899 383 ts_manager.cc:194] Registered new tserver with Master: ccf4ec9f238a43cd8c38ce4a17d76f4f (127.19.77.130:44545)
I20260805 22:39:53.367499 383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:39611
Aug 05 22:39:53 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969593, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:53.608408 859 heartbeater.cc:464] Registering TS with master...
I20260805 22:39:53.608562 859 heartbeater.cc:511] Master 127.19.77.190:43577 requested a full tablet report, sending...
I20260805 22:39:53.608928 383 ts_manager.cc:194] Registered new tserver with Master: c515c5afe34f4c958c06cd38ad0167fa (127.19.77.131:45389)
I20260805 22:39:53.609421 383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:59315
I20260805 22:39:53.611797 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:39:53.632297 880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:53.615322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36684 (local address 127.19.77.190:43577)
0805 22:39:53.615829 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:53.615831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:53.615839 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:39:53.615867 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:53.615867 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:53.615880 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:53.616958 (+ 1078us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:53.617020 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.617748 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.618820 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.619059 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.619152 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:53.627779 (+ 8627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:53.627781 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:53.627782 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:53.627793 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:53.630459 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:53.631035 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:53.631036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:53.631037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:53.631104 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:53.631426 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:53.631426 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:53.631427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:53.631584 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:53.632059 (+ 475us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:53.632101 (+ 42us) server_negotiation.cc:299] Negotiation successful
0805 22:39:53.632194 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":77,"threads_started":1}
I20260805 22:39:53.634743 383 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:39:53.637287 383 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:39:53.650146 887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:53.640846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:45389 (local address 127.0.0.1:37398)
0805 22:39:53.641325 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:53.641372 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:53.641447 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:53.643498 (+ 2051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:53.643502 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:53.643505 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:39:53.643605 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:53.643607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.645131 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.645132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:53.646485 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:53.646489 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.649831 (+ 3342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.649832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:53.649904 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:53.649934 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 22:39:53.649966 (+ 32us) client_negotiation.cc:240] Negotiation successful
0805 22:39:53.650028 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":303,"threads_started":1}
I20260805 22:39:53.650560 888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:53.641160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40548 (local address 127.19.77.129:38015)
0805 22:39:53.641597 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:53.641603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:53.642037 (+ 434us) server_negotiation.cc:407] Connection header received
0805 22:39:53.644408 (+ 2371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:53.644411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:53.644434 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:53.644493 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:39:53.645169 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.647226 (+ 2057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.648815 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.649587 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.649651 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:53.649715 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:53.650425 (+ 710us) server_negotiation.cc:299] Negotiation successful
0805 22:39:53.650476 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":52,"threads_started":1}
I20260805 22:39:53.650144 886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:53.640848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:38015 (local address 127.0.0.1:40548)
0805 22:39:53.641934 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:53.641967 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:53.642044 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:53.644639 (+ 2595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:53.644640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:53.644642 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:39:53.645071 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:53.645076 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.647395 (+ 2319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.647396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:53.648706 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:53.648709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.649782 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.649783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:53.649897 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:53.649913 (+ 16us) client_negotiation.cc:769] Sending connection context
0805 22:39:53.649981 (+ 68us) client_negotiation.cc:240] Negotiation successful
0805 22:39:53.650045 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1065,"thread_start_us":127,"threads_started":1}
I20260805 22:39:53.651055 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:53.641294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37398 (local address 127.19.77.131:45389)
0805 22:39:53.643290 (+ 1996us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:53.643296 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:53.643308 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:39:53.643347 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:53.643350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:53.643367 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:53.643463 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:39:53.643860 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.645009 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.646947 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.647787 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.650192 (+ 2405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:53.650557 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:53.650589 (+ 32us) server_negotiation.cc:299] Negotiation successful
0805 22:39:53.650974 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1955,"thread_start_us":75,"threads_started":1}
I20260805 22:39:53.651448 503 tablet_service.cc:1467] Processing CreateTablet for tablet c99d0136c611466f99464e44b08681a5 (DEFAULT_TABLE table=test-table [id=a90552696a594f5c81c3ad00a7c216ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:39:53.651860 503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c99d0136c611466f99464e44b08681a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:53.651810 791 tablet_service.cc:1467] Processing CreateTablet for tablet c99d0136c611466f99464e44b08681a5 (DEFAULT_TABLE table=test-table [id=a90552696a594f5c81c3ad00a7c216ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:39:53.652145 791 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c99d0136c611466f99464e44b08681a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:53.656493 892 tablet_bootstrap.cc:492] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: Bootstrap starting.
I20260805 22:39:53.657444 892 tablet_bootstrap.cc:654] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:53.657888 892 log.cc:824] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:53.658629 893 tablet_bootstrap.cc:492] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c: Bootstrap starting.
I20260805 22:39:53.660892 893 tablet_bootstrap.cc:654] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:53.661716 893 log.cc:824] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:53.664917 893 tablet_bootstrap.cc:492] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c: No bootstrap required, opened a new log
I20260805 22:39:53.665017 893 ts_tablet_manager.cc:1397] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260805 22:39:53.669857 893 raft_consensus.cc:348] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5522dc730d49688fe406fc50ed506c" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 38015 } } peers { permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 } } peers { permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 } }
I20260805 22:39:53.670102 893 raft_consensus.cc:374] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:53.670140 893 raft_consensus.cc:729] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5522dc730d49688fe406fc50ed506c, State: Initialized, Role: FOLLOWER
I20260805 22:39:53.670385 893 consensus_queue.cc:260] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5522dc730d49688fe406fc50ed506c" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 38015 } } peers { permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 } } peers { permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 } }
I20260805 22:39:53.670800 893 ts_tablet_manager.cc:1428] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260805 22:39:53.671101 587 heartbeater.cc:503] Master 127.19.77.190:43577 was elected leader, sending a full tablet report...
I20260805 22:39:53.671375 890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:53.641634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:44545 (local address 127.0.0.1:50706)
0805 22:39:53.647917 (+ 6283us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:53.647931 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:53.647991 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:53.648337 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:53.648338 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:53.648340 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:39:53.648411 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:53.648413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.657048 (+ 8635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.657050 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:53.668530 (+ 11480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:53.668536 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.670940 (+ 2404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.670942 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:53.671053 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:53.671060 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 22:39:53.671121 (+ 61us) client_negotiation.cc:240] Negotiation successful
0805 22:39:53.671277 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6260,"thread_start_us":71,"threads_started":1}
I20260805 22:39:53.671846 892 tablet_bootstrap.cc:492] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: No bootstrap required, opened a new log
I20260805 22:39:53.671941 892 ts_tablet_manager.cc:1397] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260805 22:39:53.672784 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:53.641743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50706 (local address 127.19.77.130:44545)
0805 22:39:53.643742 (+ 1999us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:53.643747 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:53.648078 (+ 4331us) server_negotiation.cc:407] Connection header received
0805 22:39:53.648133 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:53.648137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:53.648158 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:53.648244 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:39:53.648509 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.656910 (+ 8401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.669771 (+ 12861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:53.670704 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:53.670797 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:53.670864 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:53.672257 (+ 1393us) server_negotiation.cc:299] Negotiation successful
0805 22:39:53.672317 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1958,"thread_start_us":65,"threads_started":1}
I20260805 22:39:53.673659 655 tablet_service.cc:1467] Processing CreateTablet for tablet c99d0136c611466f99464e44b08681a5 (DEFAULT_TABLE table=test-table [id=a90552696a594f5c81c3ad00a7c216ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:39:53.674104 655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c99d0136c611466f99464e44b08681a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:53.676306 892 raft_consensus.cc:348] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5522dc730d49688fe406fc50ed506c" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 38015 } } peers { permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 } } peers { permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 } }
I20260805 22:39:53.676497 892 raft_consensus.cc:374] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:53.676542 892 raft_consensus.cc:729] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c515c5afe34f4c958c06cd38ad0167fa, State: Initialized, Role: FOLLOWER
I20260805 22:39:53.676699 892 consensus_queue.cc:260] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5522dc730d49688fe406fc50ed506c" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 38015 } } peers { permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 } } peers { permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 } }
I20260805 22:39:53.677134 892 ts_tablet_manager.cc:1428] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260805 22:39:53.677307 859 heartbeater.cc:503] Master 127.19.77.190:43577 was elected leader, sending a full tablet report...
I20260805 22:39:53.682389 898 tablet_bootstrap.cc:492] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: Bootstrap starting.
I20260805 22:39:53.684168 898 tablet_bootstrap.cc:654] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:53.684919 898 log.cc:824] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:53.686622 898 tablet_bootstrap.cc:492] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: No bootstrap required, opened a new log
I20260805 22:39:53.686843 898 ts_tablet_manager.cc:1397] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260805 22:39:53.691735 898 raft_consensus.cc:348] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5522dc730d49688fe406fc50ed506c" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 38015 } } peers { permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 } } peers { permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 } }
I20260805 22:39:53.691977 898 raft_consensus.cc:374] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:53.692008 898 raft_consensus.cc:729] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf4ec9f238a43cd8c38ce4a17d76f4f, State: Initialized, Role: FOLLOWER
I20260805 22:39:53.692270 898 consensus_queue.cc:260] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5522dc730d49688fe406fc50ed506c" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 38015 } } peers { permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 } } peers { permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 } }
I20260805 22:39:53.692726 722 heartbeater.cc:503] Master 127.19.77.190:43577 was elected leader, sending a full tablet report...
I20260805 22:39:53.692989 898 ts_tablet_manager.cc:1428] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
W20260805 22:39:53.844149 860 tablet.cc:2369] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:39:53.847199 723 tablet.cc:2369] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:39:53.917667 588 tablet.cc:2369] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 05 22:39:53 dist-test-slave-chsk krb5kdc[31827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969593, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for HTTP/127.19.77.148@KRBTEST.COM
I20260805 22:39:54.077833 896 raft_consensus.cc:482] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:39:54.078079 896 raft_consensus.cc:504] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5522dc730d49688fe406fc50ed506c" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 38015 } } peers { permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 } } peers { permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 } }
I20260805 22:39:54.078704 896 leader_election.cc:288] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccf4ec9f238a43cd8c38ce4a17d76f4f (127.19.77.130:44545), c515c5afe34f4c958c06cd38ad0167fa (127.19.77.131:45389)
I20260805 22:39:54.083938 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:54.079788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:38465 (local address 127.19.77.131:45389)
0805 22:39:54.079869 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:54.079871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:54.079880 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:39:54.079908 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:54.079909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:54.079919 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:54.080083 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:39:54.080348 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:54.081094 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:54.082824 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:54.083468 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:54.083526 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:54.083536 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:54.083800 (+ 264us) server_negotiation.cc:299] Negotiation successful
0805 22:39:54.083853 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260805 22:39:54.084077 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:54.079736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:40587 (local address 127.19.77.130:44545)
0805 22:39:54.079849 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:54.079851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:54.079863 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:39:54.079895 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:54.079896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:54.079906 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:54.079971 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:39:54.080278 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:54.081003 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:54.082827 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:54.083495 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:54.083551 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:54.083574 (+ 23us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:54.083958 (+ 384us) server_negotiation.cc:299] Negotiation successful
0805 22:39:54.084005 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260805 22:39:54.084412 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:54.079098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:44545 (local address 127.19.77.129:40587)
0805 22:39:54.079388 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:54.079403 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:54.079484 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:54.080031 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:54.080032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:54.080034 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:39:54.080172 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:54.080175 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:54.081120 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:54.081121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:54.082708 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:54.082711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:54.083644 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:54.083645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:54.083852 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:54.083857 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:39:54.084208 (+ 351us) client_negotiation.cc:240] Negotiation successful
0805 22:39:54.084262 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":4,"thread_start_us":194,"threads_started":1}
I20260805 22:39:54.084700 904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:54.079455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:45389 (local address 127.19.77.129:38465)
0805 22:39:54.079604 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:54.079613 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:54.079651 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:54.080147 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:54.080148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:54.080151 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:39:54.080254 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:54.080256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:54.081214 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:54.081215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:54.082698 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:54.082702 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:54.083630 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:54.083631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:54.083707 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:54.083711 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:39:54.084420 (+ 709us) client_negotiation.cc:240] Negotiation successful
0805 22:39:54.084605 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":141,"thread_start_us":113,"threads_started":1}
I20260805 22:39:54.085021 664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c99d0136c611466f99464e44b08681a5" candidate_uuid: "6b5522dc730d49688fe406fc50ed506c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" is_pre_election: true
I20260805 22:39:54.085220 664 raft_consensus.cc:2454] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5522dc730d49688fe406fc50ed506c in term 0.
I20260805 22:39:54.085212 811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c99d0136c611466f99464e44b08681a5" candidate_uuid: "6b5522dc730d49688fe406fc50ed506c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c515c5afe34f4c958c06cd38ad0167fa" is_pre_election: true
I20260805 22:39:54.085374 811 raft_consensus.cc:2454] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5522dc730d49688fe406fc50ed506c in term 0.
I20260805 22:39:54.085572 471 leader_election.cc:302] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5522dc730d49688fe406fc50ed506c, ccf4ec9f238a43cd8c38ce4a17d76f4f; no voters:
I20260805 22:39:54.085729 896 raft_consensus.cc:2781] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:39:54.085775 896 raft_consensus.cc:482] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:39:54.085804 896 raft_consensus.cc:3037] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:39:54.087123 896 raft_consensus.cc:504] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5522dc730d49688fe406fc50ed506c" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 38015 } } peers { permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 } } peers { permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 } }
I20260805 22:39:54.087311 896 leader_election.cc:288] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [CANDIDATE]: Term 1 election: Requested vote from peers ccf4ec9f238a43cd8c38ce4a17d76f4f (127.19.77.130:44545), c515c5afe34f4c958c06cd38ad0167fa (127.19.77.131:45389)
I20260805 22:39:54.087644 811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c99d0136c611466f99464e44b08681a5" candidate_uuid: "6b5522dc730d49688fe406fc50ed506c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c515c5afe34f4c958c06cd38ad0167fa"
I20260805 22:39:54.087743 811 raft_consensus.cc:3037] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:39:54.089046 811 raft_consensus.cc:2454] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5522dc730d49688fe406fc50ed506c in term 1.
I20260805 22:39:54.089366 473 leader_election.cc:302] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5522dc730d49688fe406fc50ed506c, c515c5afe34f4c958c06cd38ad0167fa; no voters:
I20260805 22:39:54.089615 896 raft_consensus.cc:2781] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:39:54.089655 664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c99d0136c611466f99464e44b08681a5" candidate_uuid: "6b5522dc730d49688fe406fc50ed506c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f"
I20260805 22:39:54.089756 664 raft_consensus.cc:3037] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:39:54.089891 896 raft_consensus.cc:686] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [term 1 LEADER]: Becoming Leader. State: Replica: 6b5522dc730d49688fe406fc50ed506c, State: Running, Role: LEADER
I20260805 22:39:54.090024 896 consensus_queue.cc:237] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5522dc730d49688fe406fc50ed506c" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 38015 } } peers { permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 } } peers { permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 } }
I20260805 22:39:54.090725 664 raft_consensus.cc:2454] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5522dc730d49688fe406fc50ed506c in term 1.
I20260805 22:39:54.091099 382 catalog_manager.cc:5495] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5522dc730d49688fe406fc50ed506c (127.19.77.129). New cstate: current_term: 1 leader_uuid: "6b5522dc730d49688fe406fc50ed506c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5522dc730d49688fe406fc50ed506c" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 38015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 } health_report { overall_health: UNKNOWN } } }
I20260805 22:39:54.105921 888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:54.102526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40564 (local address 127.19.77.129:38015)
0805 22:39:54.102575 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:54.102577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:54.102586 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:39:54.102633 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:54.102634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:54.102658 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:54.102733 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:39:54.102982 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:54.103642 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:54.104698 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:54.104986 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:54.105059 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:54.105277 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:39:54.105430 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:39:54.105517 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:54.105808 (+ 291us) server_negotiation.cc:299] Negotiation successful
0805 22:39:54.105834 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:39:54.109218 811 raft_consensus.cc:1261] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa [term 1 FOLLOWER]: Refusing update from remote peer 6b5522dc730d49688fe406fc50ed506c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:39:54.109723 905 consensus_queue.cc:1035] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c515c5afe34f4c958c06cd38ad0167fa" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 45389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:39:54.111867 664 raft_consensus.cc:1261] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f [term 1 FOLLOWER]: Refusing update from remote peer 6b5522dc730d49688fe406fc50ed506c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:39:54.112167 905 consensus_queue.cc:1035] T c99d0136c611466f99464e44b08681a5 P 6b5522dc730d49688fe406fc50ed506c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf4ec9f238a43cd8c38ce4a17d76f4f" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 44545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:39:54.122769 908 mvcc.cc:205] Tried to move back new op lower bound from 7315331457467076608 to 7315331457393012736. Current Snapshot: MvccSnapshot[applied={T|T < 7315331457467076608}]
I20260805 22:39:54.122983 911 mvcc.cc:205] Tried to move back new op lower bound from 7315331457467076608 to 7315331457393012736. Current Snapshot: MvccSnapshot[applied={T|T < 7315331457467076608}]
I20260805 22:39:54.124788 909 mvcc.cc:205] Tried to move back new op lower bound from 7315331457467076608 to 7315331457393012736. Current Snapshot: MvccSnapshot[applied={T|T < 7315331457467076608}]
I20260805 22:39:54.129470 382 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:39:54.129588 382 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:39:54.130551 382 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1909bc4de49e4c4db974eb95ba27a326: Sending DeleteTablet for 3 replicas of tablet c99d0136c611466f99464e44b08681a5
I20260805 22:39:54.130977 503 tablet_service.cc:1514] Processing DeleteTablet for tablet c99d0136c611466f99464e44b08681a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:39:54 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:40548
I20260805 22:39:54.130995 655 tablet_service.cc:1514] Processing DeleteTablet for tablet c99d0136c611466f99464e44b08681a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:39:54 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:50706
I20260805 22:39:54.131069 791 tablet_service.cc:1514] Processing DeleteTablet for tablet c99d0136c611466f99464e44b08681a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:39:54 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:37398
I20260805 22:39:54.131845 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 423
I20260805 22:39:54.139410 917 tablet_replica.cc:330] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: stopping tablet replica
I20260805 22:39:54.139606 917 raft_consensus.cc:2229] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:39:54.139783 917 raft_consensus.cc:2258] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:39:54.140476 917 ts_tablet_manager.cc:1905] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:39:54.143299 917 ts_tablet_manager.cc:1918] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:39:54.143421 917 log.cc:1196] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/c99d0136c611466f99464e44b08681a5
I20260805 22:39:54.143713 917 ts_tablet_manager.cc:1939] T c99d0136c611466f99464e44b08681a5 P ccf4ec9f238a43cd8c38ce4a17d76f4f: Deleting consensus metadata
I20260805 22:39:54.144454 367 catalog_manager.cc:4841] TS ccf4ec9f238a43cd8c38ce4a17d76f4f (127.19.77.130:44545): tablet c99d0136c611466f99464e44b08681a5 (table test-table [id=a90552696a594f5c81c3ad00a7c216ed]) successfully deleted
I20260805 22:39:54.144862 920 tablet_replica.cc:330] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: stopping tablet replica
I20260805 22:39:54.145006 920 raft_consensus.cc:2229] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:39:54.145138 920 raft_consensus.cc:2258] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:39:54.145777 920 ts_tablet_manager.cc:1905] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:39:54.148025 920 ts_tablet_manager.cc:1918] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:39:54.148195 920 log.cc:1196] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/c99d0136c611466f99464e44b08681a5
I20260805 22:39:54.148579 920 ts_tablet_manager.cc:1939] T c99d0136c611466f99464e44b08681a5 P c515c5afe34f4c958c06cd38ad0167fa: Deleting consensus metadata
W20260805 22:39:54.149026 368 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:38015 (error 108)
I20260805 22:39:54.149559 369 catalog_manager.cc:4841] TS c515c5afe34f4c958c06cd38ad0167fa (127.19.77.131:45389): tablet c99d0136c611466f99464e44b08681a5 (table test-table [id=a90552696a594f5c81c3ad00a7c216ed]) successfully deleted
I20260805 22:39:54.150152 890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:54.149980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:38015 (local address 127.0.0.1:40576)
0805 22:39:54.150035 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:54.150116 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:38015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260805 22:39:54.150296 368 catalog_manager.cc:4584] TS 6b5522dc730d49688fe406fc50ed506c (127.19.77.129:38015): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c99d0136c611466f99464e44b08681a5: Network error: Client connection negotiation failed: client connection to 127.19.77.129:38015: connect: Connection refused (error 111)
I20260805 22:39:54.151073 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 589
I20260805 22:39:54.159852 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 725
I20260805 22:39:54.166818 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 350
I20260805 22:39:54.174227 19766 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260805 22:39:54.519766 19766 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260805 22:39:54.519902 19766 mini_ranger.cc:66] Stopping Ranger...
I20260805 22:39:54.865447 19766 mini_ranger.cc:68] Stopped Ranger
2026-08-05 22:39:54.865 UTC [31859] LOG: received smart shutdown request
2026-08-05 22:39:54.870 UTC [31859] LOG: background worker "logical replication launcher" (PID 31868) exited with exit code 1
2026-08-05 22:39:54.870 UTC [31863] LOG: shutting down
2026-08-05 22:39:55.050 UTC [31859] LOG: database system is shut down
2026-08-05T22:39:55Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53147 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:39:55 dist-test-slave-chsk krb5kdc[930](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:39:55 dist-test-slave-chsk krb5kdc[930](info): set up 2 sockets
Aug 05 22:39:55 dist-test-slave-chsk krb5kdc[930](info): commencing operation
krb5kdc: starting...
W20260805 22:39:56.243242 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:39:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:39:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:39:56.378206 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:35849
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:35849,127.19.77.189:36107,127.19.77.188:35275
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:39:56.465931 943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:56.466246 943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:56.466292 943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:56.467593 943 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:39:56.467679 943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:56.467705 943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:56.467725 943 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:39:56.467756 943 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:39:56.469476 943 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:35849,127.19.77.189:36107,127.19.77.188:35275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:35849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:56.469985 943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:56.470290 943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:56.475679 950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:56.475682 951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:56.475920 943 server_base.cc:1034] running on GCE node
W20260805 22:39:56.475679 953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:56.476342 943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:56.476716 943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:56.477892 943 hybrid_clock.cc:648] HybridClock initialized: now 1785969596477883 us; error 47 us; skew 500 ppm
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:56.480834 943 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:39:56.481462 943 webserver.cc:460] Webserver started at http://127.19.77.190:35179/ using document root <none> and password file <none>
I20260805 22:39:56.481721 943 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:56.481797 943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:56.481972 943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:39:56.483131 943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "8a23ee70aa7e4ee7b3d6861480c17c20"
format_stamp: "Formatted at 2026-08-05 22:39:56 on dist-test-slave-chsk"
server_key: "52398aca9f4d2e9d8028bccdb51e55cd"
server_key_iv: "7694f2d99cfee25efc2fcd1696692d01"
server_key_version: "encryptionkey@0"
I20260805 22:39:56.483618 943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "8a23ee70aa7e4ee7b3d6861480c17c20"
format_stamp: "Formatted at 2026-08-05 22:39:56 on dist-test-slave-chsk"
server_key: "52398aca9f4d2e9d8028bccdb51e55cd"
server_key_iv: "7694f2d99cfee25efc2fcd1696692d01"
server_key_version: "encryptionkey@0"
I20260805 22:39:56.485426 943 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260805 22:39:56.486428 961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:56.486660 943 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:39:56.486776 943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "8a23ee70aa7e4ee7b3d6861480c17c20"
format_stamp: "Formatted at 2026-08-05 22:39:56 on dist-test-slave-chsk"
server_key: "52398aca9f4d2e9d8028bccdb51e55cd"
server_key_iv: "7694f2d99cfee25efc2fcd1696692d01"
server_key_version: "encryptionkey@0"
I20260805 22:39:56.486867 943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:56.503706 943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:56.506306 943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:56.506542 943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:56.511317 943 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:35849
I20260805 22:39:56.511375 1013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:35849 every 8 connection(s)
I20260805 22:39:56.511773 943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:39:56.512739 1014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:56.514793 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 943
I20260805 22:39:56.514938 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:39:56.514729 1014 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:39:56.515177 19766 external_mini_cluster.cc:1428] Setting key 7813a0e0b56704b7aa0296e79f347fe7
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.189@KRBTEST.COM; defaulting to no policy
I20260805 22:39:56.527289 1016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.515692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39460 (local address 127.19.77.190:35849)
0805 22:39:56.516005 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.516042 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.516135 (+ 93us) server_negotiation.cc:407] Connection header received
0805 22:39:56.516773 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.516775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.516794 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.516912 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.517609 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.518667 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.520265 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.520798 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.520948 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.523593 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.523605 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.523606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.523615 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.525569 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.526052 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.526056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.526056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.526156 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.526398 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.526399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.526399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.526641 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.526709 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.526916 (+ 207us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.527024 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":114,"threads_started":1}
I20260805 22:39:56.527383 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.515673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35849 (local address 127.0.0.1:39460)
0805 22:39:56.515993 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.516043 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:56.516589 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:56.516968 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:56.516972 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:56.517313 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:56.517487 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.517492 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.518789 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.518790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.520134 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.520139 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.520913 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.520914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.520979 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.521642 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:56.521652 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:56.523479 (+ 1827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:56.525674 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.525682 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.525684 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.525934 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.526238 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.526239 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.526239 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.526332 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.526722 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:56.526728 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:56.526793 (+ 65us) client_negotiation.cc:769] Sending connection context
0805 22:39:56.526876 (+ 83us) client_negotiation.cc:240] Negotiation successful
0805 22:39:56.527199 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":93,"thread_start_us":116,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.189@KRBTEST.COM" created.
I20260805 22:39:56.528119 1014 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:39:56.528539 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.528427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:36107 (local address 127.0.0.1:41426)
0805 22:39:56.528469 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.528517 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:36107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260805 22:39:56.528724 962 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.77.189:36107: connect: Connection refused (error 111)
I20260805 22:39:56.529248 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.529128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:36107 (local address 127.0.0.1:41440)
0805 22:39:56.529179 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.529215 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:36107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260805 22:39:56.529421 1014 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.189:36107: Network error: Client connection negotiation failed: client connection to 127.19.77.189:36107: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab.
Entry for principal kudu/127.19.77.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab.
I20260805 22:39:56.547132 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.189:36107
--webserver_interface=127.19.77.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab
--principal=kudu/127.19.77.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:35849,127.19.77.189:36107,127.19.77.188:35275
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:39:56.578716 1014 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } attempt: 1
I20260805 22:39:56.579391 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.579224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:36107 (local address 127.0.0.1:41442)
0805 22:39:56.579300 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.579353 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:36107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260805 22:39:56.579809 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.579699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:36107 (local address 127.0.0.1:41458)
0805 22:39:56.579753 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.579785 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:36107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260805 22:39:56.579958 1014 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.189:36107: Network error: Client connection negotiation failed: client connection to 127.19.77.189:36107: connect: Connection refused (error 111)
W20260805 22:39:56.635943 1022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:56.636185 1022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:56.636212 1022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:56.637490 1022 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:39:56.637547 1022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:56.637562 1022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:56.637576 1022 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:39:56.637589 1022 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:39:56.639339 1022 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:35849,127.19.77.189:36107,127.19.77.188:35275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab
--principal=kudu/127.19.77.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.189:36107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.77.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:56.639647 1022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:56.639916 1022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:56.645195 1027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:56.645144 1030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:56.645148 1028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:56.645388 1022 server_base.cc:1034] running on GCE node
I20260805 22:39:56.645671 1022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:56.645985 1022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:56.647218 1022 hybrid_clock.cc:648] HybridClock initialized: now 1785969596647206 us; error 49 us; skew 500 ppm
I20260805 22:39:56.648146 1014 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } attempt: 2
I20260805 22:39:56.648607 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.648451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:36107 (local address 127.0.0.1:41468)
0805 22:39:56.648522 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.648566 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:36107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260805 22:39:56.649010 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.648901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:36107 (local address 127.0.0.1:41470)
0805 22:39:56.648953 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.648984 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:36107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260805 22:39:56.649135 1014 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.189:36107: Network error: Client connection negotiation failed: client connection to 127.19.77.189:36107: connect: Connection refused (error 111)
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:56.650261 1022 init.cc:377] Logged in from keytab as kudu/127.19.77.189@KRBTEST.COM (short username kudu)
I20260805 22:39:56.650774 1022 webserver.cc:460] Webserver started at http://127.19.77.189:39229/ using document root <none> and password file <none>
I20260805 22:39:56.650998 1022 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:56.651041 1022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:56.651198 1022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:39:56.652304 1022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/data/instance:
uuid: "9e383bdf437b42299b2debb720d871c2"
format_stamp: "Formatted at 2026-08-05 22:39:56 on dist-test-slave-chsk"
server_key: "b2bbccc077e174c193e02efccb17c59f"
server_key_iv: "e685dc2a7118c9412251ad46f4e25fe8"
server_key_version: "encryptionkey@0"
I20260805 22:39:56.652604 1022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/wal/instance:
uuid: "9e383bdf437b42299b2debb720d871c2"
format_stamp: "Formatted at 2026-08-05 22:39:56 on dist-test-slave-chsk"
server_key: "b2bbccc077e174c193e02efccb17c59f"
server_key_iv: "e685dc2a7118c9412251ad46f4e25fe8"
server_key_version: "encryptionkey@0"
I20260805 22:39:56.654040 1022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:39:56.654844 1037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:56.655088 1022 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:39:56.655220 1022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/wal
uuid: "9e383bdf437b42299b2debb720d871c2"
format_stamp: "Formatted at 2026-08-05 22:39:56 on dist-test-slave-chsk"
server_key: "b2bbccc077e174c193e02efccb17c59f"
server_key_iv: "e685dc2a7118c9412251ad46f4e25fe8"
server_key_version: "encryptionkey@0"
I20260805 22:39:56.655301 1022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:56.683482 1022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:56.686036 1022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:56.686172 1022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:56.690836 1022 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.189:36107
I20260805 22:39:56.690900 1090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.189:36107 every 8 connection(s)
I20260805 22:39:56.691367 1022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
I20260805 22:39:56.692360 1091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:56.693554 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 1022
I20260805 22:39:56.693722 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-1/wal/instance
I20260805 22:39:56.693938 19766 external_mini_cluster.cc:1428] Setting key 9891e6ea5dcb5eebb9ca04d6e13defb5
I20260805 22:39:56.694250 1091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.188@KRBTEST.COM; defaulting to no policy
I20260805 22:39:56.704406 1016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.695113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39472 (local address 127.19.77.190:35849)
0805 22:39:56.695181 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.695183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.695485 (+ 302us) server_negotiation.cc:407] Connection header received
0805 22:39:56.696135 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.696137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.696155 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.696231 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.696903 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.697428 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.698457 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.698700 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.698794 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.701252 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.701254 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.701254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.701263 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.702795 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.703335 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.703336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.703337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.703412 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.703698 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.703699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.703700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.703830 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.703909 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.704210 (+ 301us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.704308 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:39:56.704618 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.695092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35849 (local address 127.0.0.1:39472)
0805 22:39:56.695329 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.695377 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:56.696016 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:56.696305 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:56.696309 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:56.696590 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:56.696804 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.696808 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.697528 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.697528 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.698347 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.698350 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.698809 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.698810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.698985 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.699658 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:56.699668 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:56.701138 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:56.702896 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.702908 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.702910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.703243 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.703487 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.703488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.703489 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.703620 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.703900 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:56.703908 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:56.704065 (+ 157us) client_negotiation.cc:769] Sending connection context
0805 22:39:56.704178 (+ 113us) client_negotiation.cc:240] Negotiation successful
0805 22:39:56.704357 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":135,"threads_started":1}
I20260805 22:39:56.705241 1091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.188@KRBTEST.COM" created.
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
I20260805 22:39:56.714239 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.705557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:36107 (local address 127.0.0.1:41476)
0805 22:39:56.705630 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.705643 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:56.705697 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:56.706020 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:56.706021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:56.706173 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:56.706251 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.706253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.707286 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.707287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.708127 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.708130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.708925 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.708926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.709002 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.709529 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:56.709533 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:56.711086 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:56.713090 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.713091 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.713091 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.713271 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.713506 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.713507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.713507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.713571 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.713885 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:56.713886 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:56.713927 (+ 41us) client_negotiation.cc:769] Sending connection context
0805 22:39:56.713995 (+ 68us) client_negotiation.cc:240] Negotiation successful
0805 22:39:56.714125 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260805 22:39:56.714401 1095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.705635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41476 (local address 127.19.77.189:36107)
0805 22:39:56.705802 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.705806 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.705824 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:39:56.705843 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.705845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.705857 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.705919 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.706322 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.707184 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.708256 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.708820 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.708904 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.711213 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.711229 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.711229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.711238 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.712983 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.713372 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.713376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.713376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.713437 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.713637 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.713638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.713638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.713804 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.713897 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.714037 (+ 140us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.714240 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":104,"server-negotiator.queue_time_us":136,"thread_start_us":106,"threads_started":1}
I20260805 22:39:56.715103 1091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:39:56.715552 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.715421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57138)
0805 22:39:56.715474 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.715529 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260805 22:39:56.715685 1040 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
I20260805 22:39:56.716122 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.716021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57150)
0805 22:39:56.716069 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.716094 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260805 22:39:56.716228 1091 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35275: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab.
Entry for principal kudu/127.19.77.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab.
I20260805 22:39:56.726414 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.188:35275
--webserver_interface=127.19.77.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab
--principal=kudu/127.19.77.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:35849,127.19.77.189:36107,127.19.77.188:35275
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:39:56.740353 1014 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } attempt: 3
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
I20260805 22:39:56.747939 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.740855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:36107 (local address 127.0.0.1:41484)
0805 22:39:56.740915 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.740934 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:56.741004 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:56.741168 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:56.741169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:56.741343 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:56.741422 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.741424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.742148 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.742149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.742644 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.742646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.743038 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.743039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.743125 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.743744 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:56.743749 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:56.745053 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:56.746890 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.746892 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.746892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.747076 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.747324 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.747325 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.747325 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.747381 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.747673 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:56.747674 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:56.747720 (+ 46us) client_negotiation.cc:769] Sending connection context
0805 22:39:56.747773 (+ 53us) client_negotiation.cc:240] Negotiation successful
0805 22:39:56.747863 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260805 22:39:56.748010 1095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.740943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41484 (local address 127.19.77.189:36107)
0805 22:39:56.741015 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.741017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.741031 (+ 14us) server_negotiation.cc:407] Connection header received
0805 22:39:56.741070 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.741071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.741084 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.741160 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.741513 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.742054 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.742731 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.742951 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.743033 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.745173 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.745175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.745175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.745186 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.746786 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.747183 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.747184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.747184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.747251 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.747447 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.747447 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.747448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.747605 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.747684 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.747820 (+ 136us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.747910 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260805 22:39:56.748365 1014 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:39:56.748785 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.748654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57158)
0805 22:39:56.748714 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.748754 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260805 22:39:56.749146 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.749050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57174)
0805 22:39:56.749100 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.749127 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260805 22:39:56.749265 1014 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35275: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
I20260805 22:39:56.765468 1091 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } attempt: 1
I20260805 22:39:56.765983 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.765841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57186)
0805 22:39:56.765909 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.765951 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 22:39:56.766346 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.766244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57194)
0805 22:39:56.766292 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.766320 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260805 22:39:56.766433 1091 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35275: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
I20260805 22:39:56.780442 1014 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } attempt: 1
I20260805 22:39:56.781009 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.780827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57200)
0805 22:39:56.780912 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.780968 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260805 22:39:56.781493 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.781392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57214)
0805 22:39:56.781441 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.781471 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260805 22:39:56.781602 1014 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35275: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
W20260805 22:39:56.817425 1099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:56.817682 1099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:56.817708 1099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:56.818956 1099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:39:56.819013 1099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:56.819028 1099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:56.819042 1099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:39:56.819054 1099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:39:56.820871 1099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:35849,127.19.77.189:36107,127.19.77.188:35275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab
--principal=kudu/127.19.77.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.188:35275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.77.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:56.821197 1099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:56.821473 1099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:56.826824 1105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:56.826815 1104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:56.826982 1099 server_base.cc:1034] running on GCE node
W20260805 22:39:56.826817 1107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:56.827327 1099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:56.827731 1099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:56.828940 1099 hybrid_clock.cc:648] HybridClock initialized: now 1785969596828913 us; error 38 us; skew 500 ppm
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:56.831851 1099 init.cc:377] Logged in from keytab as kudu/127.19.77.188@KRBTEST.COM (short username kudu)
I20260805 22:39:56.832424 1099 webserver.cc:460] Webserver started at http://127.19.77.188:34333/ using document root <none> and password file <none>
I20260805 22:39:56.832680 1099 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:56.832755 1099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:56.832952 1099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:39:56.834096 1099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/data/instance:
uuid: "fd4ed8bacb4645768d2f1dbc434b26c8"
format_stamp: "Formatted at 2026-08-05 22:39:56 on dist-test-slave-chsk"
server_key: "9d7eff63275d1d4011cafb905104a2f0"
server_key_iv: "80e9c92e3052017fab20ea977fc0c7eb"
server_key_version: "encryptionkey@0"
I20260805 22:39:56.834509 1099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/wal/instance:
uuid: "fd4ed8bacb4645768d2f1dbc434b26c8"
format_stamp: "Formatted at 2026-08-05 22:39:56 on dist-test-slave-chsk"
server_key: "9d7eff63275d1d4011cafb905104a2f0"
server_key_iv: "80e9c92e3052017fab20ea977fc0c7eb"
server_key_version: "encryptionkey@0"
I20260805 22:39:56.834578 1091 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } attempt: 2
I20260805 22:39:56.835067 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.834932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57224)
0805 22:39:56.835000 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.835038 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260805 22:39:56.835481 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.835375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57232)
0805 22:39:56.835425 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.835458 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260805 22:39:56.835577 1091 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35275: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
I20260805 22:39:56.836390 1099 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260805 22:39:56.837507 1114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:56.837766 1099 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:39:56.837888 1099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/wal
uuid: "fd4ed8bacb4645768d2f1dbc434b26c8"
format_stamp: "Formatted at 2026-08-05 22:39:56 on dist-test-slave-chsk"
server_key: "9d7eff63275d1d4011cafb905104a2f0"
server_key_iv: "80e9c92e3052017fab20ea977fc0c7eb"
server_key_version: "encryptionkey@0"
I20260805 22:39:56.837982 1099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:56.856765 1014 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } attempt: 2
I20260805 22:39:56.857318 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.857172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57238)
0805 22:39:56.857243 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.857285 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260805 22:39:56.857748 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.857646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57240)
0805 22:39:56.857693 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.857727 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260805 22:39:56.857844 1014 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35275: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35275: connect: Connection refused (error 111)
I20260805 22:39:56.859771 1099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:56.862401 1099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:56.862624 1099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:56.867612 1099 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.188:35275
I20260805 22:39:56.867667 1166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.188:35275 every 8 connection(s)
I20260805 22:39:56.868069 1099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
I20260805 22:39:56.869041 1167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:56.870754 1167 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:39:56.872917 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 1099
I20260805 22:39:56.873054 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785969428667539-19766-0/minicluster-data/master-2/wal/instance
I20260805 22:39:56.873330 19766 external_mini_cluster.cc:1428] Setting key b754d5490d77376a3be0d1ba7b2e88da
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
I20260805 22:39:56.881953 1016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.871658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39478 (local address 127.19.77.190:35849)
0805 22:39:56.871748 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.871750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.871926 (+ 176us) server_negotiation.cc:407] Connection header received
0805 22:39:56.872421 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.872422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.872433 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.872490 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.873267 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.874021 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.875336 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.875690 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.875782 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.878600 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.878602 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.878602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.878612 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.880169 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.880736 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.880737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.880737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.880803 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.881150 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.881151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.881152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.881309 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.881369 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.881789 (+ 420us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.881869 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260805 22:39:56.882270 1169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.871591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35849 (local address 127.0.0.1:39478)
0805 22:39:56.871797 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.871838 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:56.872333 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:56.872557 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:56.872560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:56.872859 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:56.873146 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.873154 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.874141 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.874142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.875249 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.875251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.875826 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.875827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.876010 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.876575 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:56.876586 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:56.878448 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:56.880290 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.880303 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.880305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.880605 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.880886 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.880887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.880887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.881034 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.881393 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:56.881402 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:56.881605 (+ 203us) client_negotiation.cc:769] Sending connection context
0805 22:39:56.881749 (+ 144us) client_negotiation.cc:240] Negotiation successful
0805 22:39:56.882004 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":114,"threads_started":1}
I20260805 22:39:56.883065 1167 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:39:56.884231 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.873922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57246 (local address 127.19.77.188:35275)
0805 22:39:56.874160 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.874184 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.874879 (+ 695us) server_negotiation.cc:407] Connection header received
0805 22:39:56.874911 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.874914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.874938 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.875029 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.875826 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.876825 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.877812 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.878183 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.878243 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.880675 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.880683 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.880684 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.880692 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.882622 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.883089 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.883092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.883093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.883222 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.883638 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.883639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.883640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.883794 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.883982 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.884029 (+ 47us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.884114 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":128,"threads_started":1}
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:56.891218 1169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.883409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:36107 (local address 127.0.0.1:41500)
0805 22:39:56.883469 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.883482 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:56.883532 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:56.883741 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:56.883742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:56.883910 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:56.883957 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.883958 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.884813 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.884814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.885537 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.885539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.885912 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.885913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.885977 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.886464 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:56.886469 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:56.887923 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:56.889783 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.889784 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.889785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.890032 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.890276 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.890277 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.890278 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.890349 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.890708 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:56.890709 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:56.890766 (+ 57us) client_negotiation.cc:769] Sending connection context
0805 22:39:56.890916 (+ 150us) client_negotiation.cc:240] Negotiation successful
0805 22:39:56.891056 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260805 22:39:56.891243 1095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.883548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41500 (local address 127.19.77.189:36107)
0805 22:39:56.883617 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.883619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.883627 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:39:56.883653 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.883654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.883664 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.883737 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.884042 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.884706 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.885623 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.885836 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.885916 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.888019 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.888021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.888021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.888029 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.889673 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.890121 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.890123 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.890123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.890198 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.890465 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.890466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.890466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.890629 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.890704 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.890984 (+ 280us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.891107 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:39:56.891857 1167 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:39:56.893412 1016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.885213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39492 (local address 127.19.77.190:35849)
0805 22:39:56.885273 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.885275 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.885304 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:39:56.885367 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.885368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.885378 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.885441 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.885924 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.886387 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.887103 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.887357 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.887437 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.890267 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.890269 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.890269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.890278 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.892062 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.892515 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.892517 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.892517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.892581 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.892808 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.892809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.892810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.892936 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.893175 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.893216 (+ 41us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.893302 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
I20260805 22:39:56.899479 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.892282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57252 (local address 127.19.77.188:35275)
0805 22:39:56.892323 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.892325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.892407 (+ 82us) server_negotiation.cc:407] Connection header received
0805 22:39:56.892468 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.892469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.892481 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.892535 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.892796 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.893290 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.894059 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.894281 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.894369 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.896487 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.896488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.896489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.896495 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.898150 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.898557 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.898559 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.898559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.898624 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.898815 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.898815 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.898816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.898965 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.899038 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.899219 (+ 181us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.899340 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":21}
I20260805 22:39:56.899529 1169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.892286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57252)
0805 22:39:56.892345 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.892354 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:56.892422 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:56.892538 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:56.892539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:56.892687 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:56.892722 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.892723 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.893384 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.893385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.893977 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.893979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.894368 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.894369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.894419 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.894897 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:56.894901 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:56.896389 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:56.898239 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.898241 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.898241 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.898471 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.898695 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.898695 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.898696 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.898749 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.899033 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:56.899034 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:56.899071 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 22:39:56.899194 (+ 123us) client_negotiation.cc:240] Negotiation successful
0805 22:39:56.899396 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":103}
I20260805 22:39:56.901451 1167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8: Bootstrap starting.
I20260805 22:39:56.902673 1167 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:56.902747 1095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.894215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41514 (local address 127.19.77.189:36107)
0805 22:39:56.894254 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.894256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.894298 (+ 42us) server_negotiation.cc:407] Connection header received
0805 22:39:56.894372 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.894372 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.894382 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.894438 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.895053 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.895826 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.896737 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.896932 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.897025 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.899722 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.899724 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.899724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.899735 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.901372 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.901819 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.901820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.901821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.901894 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.902113 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.902115 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.902115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.902285 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.902500 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.902546 (+ 46us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.902642 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260805 22:39:56.903041 1167 log.cc:824] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:56.904073 1167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8: No bootstrap required, opened a new log
I20260805 22:39:56.904551 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:39:56.906167 1167 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } }
I20260805 22:39:56.906358 1167 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:56.906402 1167 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4ed8bacb4645768d2f1dbc434b26c8, State: Initialized, Role: FOLLOWER
I20260805 22:39:56.906545 1167 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } }
I20260805 22:39:56.906945 1167 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [sys.catalog]: configured and running, proceeding with master startup.
W20260805 22:39:56.909405 1192 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:39:56.909477 1192 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:39:56.909802 1099 master_runner.cc:186] Error getting master registration for 127.19.77.190:35849: OK, instance_id { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" instance_seqno: 1785969596509873 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:39:56.913017 1099 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:39:56.915086 1016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.906010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39496 (local address 127.19.77.190:35849)
0805 22:39:56.906063 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.906065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.906419 (+ 354us) server_negotiation.cc:407] Connection header received
0805 22:39:56.906504 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.906505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.906519 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.906572 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.907362 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.908164 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.909175 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.909457 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.909637 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.911559 (+ 1922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.911566 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.911567 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.911577 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.913483 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.913954 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.913955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.913956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.914015 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.914240 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.914241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.914241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.914392 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.914480 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.914883 (+ 403us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.914976 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260805 22:39:56.916074 1194 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } } }
I20260805 22:39:56.916215 1194 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:39:56.916291 1095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.906158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41518 (local address 127.19.77.189:36107)
0805 22:39:56.906202 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.906204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.906214 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:39:56.906294 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.906295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.906305 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.906366 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.907454 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.908246 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.910039 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.910341 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.910412 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.912203 (+ 1791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.912205 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.912205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.912215 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.914343 (+ 2128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.914736 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.914737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.914737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.914799 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.915015 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.915016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.915016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.915210 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.915851 (+ 641us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.916102 (+ 251us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.916193 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:39:56.916285 1194 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:39:56.916569 1194 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } }
I20260805 22:39:56.917330 1194 leader_election.cc:288] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a23ee70aa7e4ee7b3d6861480c17c20 (127.19.77.190:35849), 9e383bdf437b42299b2debb720d871c2 (127.19.77.189:36107)
I20260805 22:39:56.917443 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.906306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57268 (local address 127.19.77.188:35275)
0805 22:39:56.906350 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.906352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.906555 (+ 203us) server_negotiation.cc:407] Connection header received
0805 22:39:56.907458 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.907459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.907469 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.907499 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.908217 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.908964 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.911914 (+ 2950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.912202 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.912249 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.914054 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.914056 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.914056 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.914067 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.915867 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.916281 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.916282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.916282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.916365 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.916612 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.916613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.916614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.916911 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.917008 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.917190 (+ 182us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.917310 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:39:56.926716 1091 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } attempt: 3
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
I20260805 22:39:56.935161 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.927082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57284)
0805 22:39:56.927175 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.927188 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:56.927237 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:56.927404 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:56.927405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:56.927613 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:56.927669 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.927671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.928602 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.928604 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.929120 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.929122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.929593 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.929595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.929653 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.930190 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:56.930197 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:56.931961 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:56.933946 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.933947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.933948 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.934195 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.934423 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.934423 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.934424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.934485 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.934773 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:56.934774 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:56.934842 (+ 68us) client_negotiation.cc:769] Sending connection context
0805 22:39:56.934910 (+ 68us) client_negotiation.cc:240] Negotiation successful
0805 22:39:56.935020 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260805 22:39:56.935163 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.927189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57284 (local address 127.19.77.188:35275)
0805 22:39:56.927256 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.927258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.927269 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:39:56.927296 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.927297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.927308 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.927388 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.927761 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.928522 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.929217 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.929514 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.929586 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.932073 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.932075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.932075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.932085 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.933852 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.934282 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.934284 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.934284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.934351 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.934556 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.934557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.934558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.934717 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.934787 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.934953 (+ 166us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.935040 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260805 22:39:56.936800 1091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2: Bootstrap starting.
I20260805 22:39:56.937611 1091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:56.937847 1091 log.cc:824] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:56.938727 1091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2: No bootstrap required, opened a new log
I20260805 22:39:56.940899 1091 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } }
I20260805 22:39:56.941092 1091 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:56.941157 1091 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e383bdf437b42299b2debb720d871c2, State: Initialized, Role: FOLLOWER
I20260805 22:39:56.941315 1091 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } }
I20260805 22:39:56.941694 1091 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:39:56.941749 1064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e383bdf437b42299b2debb720d871c2" is_pre_election: true
I20260805 22:39:56.942056 1064 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4ed8bacb4645768d2f1dbc434b26c8 in term 0.
I20260805 22:39:56.942214 1196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } } }
I20260805 22:39:56.942345 1196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:39:56.942351 1115 leader_election.cc:302] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e383bdf437b42299b2debb720d871c2, fd4ed8bacb4645768d2f1dbc434b26c8; no voters:
I20260805 22:39:56.942538 1181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:39:56.942632 1181 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:39:56.942677 1181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:39:56.943776 1181 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } }
I20260805 22:39:56.943945 1181 leader_election.cc:288] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [CANDIDATE]: Term 1 election: Requested vote from peers 8a23ee70aa7e4ee7b3d6861480c17c20 (127.19.77.190:35849), 9e383bdf437b42299b2debb720d871c2 (127.19.77.189:36107)
I20260805 22:39:56.944149 1064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e383bdf437b42299b2debb720d871c2"
I20260805 22:39:56.944736 1064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [term 0 FOLLOWER]: Advancing to term 1
W20260805 22:39:56.945122 1207 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:39:56.945186 1207 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:39:56.945737 1064 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4ed8bacb4645768d2f1dbc434b26c8 in term 1.
I20260805 22:39:56.945933 1115 leader_election.cc:302] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e383bdf437b42299b2debb720d871c2, fd4ed8bacb4645768d2f1dbc434b26c8; no voters:
I20260805 22:39:56.946058 1181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:39:56.946135 1181 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [term 1 LEADER]: Becoming Leader. State: Replica: fd4ed8bacb4645768d2f1dbc434b26c8, State: Running, Role: LEADER
I20260805 22:39:56.946242 1181 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } }
I20260805 22:39:56.946817 1181 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd4ed8bacb4645768d2f1dbc434b26c8. Latest consensus state: current_term: 1 leader_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } } }
I20260805 22:39:56.946903 1181 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:39:56.947448 1210 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:39:56.947751 1210 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:39:56.944725 1022 master_runner.cc:186] Error getting master registration for 127.19.77.190:35849: OK, instance_id { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" instance_seqno: 1785969596509873 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:39:56.949172 1022 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:39:56.950060 1064 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [term 1 FOLLOWER]: Refusing update from remote peer fd4ed8bacb4645768d2f1dbc434b26c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:39:56.950425 1181 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:39:56.952104 1196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd4ed8bacb4645768d2f1dbc434b26c8. Latest consensus state: current_term: 1 leader_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } } }
I20260805 22:39:56.952214 1196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:39:56.953358 1181 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } } }
I20260805 22:39:56.953384 1196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } } }
I20260805 22:39:56.953469 1196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:39:56.953467 1181 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:39:56.954067 1210 catalog_manager.cc:1347] Generated new cluster ID: fa28273431dc428ca571118ca9346b05
I20260805 22:39:56.954195 1210 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:39:56.956990 1014 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } attempt: 3
Aug 05 22:39:56 dist-test-slave-chsk krb5kdc[930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969596, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
I20260805 22:39:56.965363 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.957332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35275 (local address 127.0.0.1:57288)
0805 22:39:56.957425 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0805 22:39:56.957436 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:39:56.957473 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:39:56.957750 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:39:56.957751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:39:56.957945 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:39:56.957995 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.957997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.958921 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.958922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.959740 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:39:56.959742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.960316 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.960317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:39:56.960370 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.960894 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:39:56.960899 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:39:56.962396 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:39:56.964350 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.964351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.964352 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.964559 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.964757 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:39:56.964757 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:39:56.964757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:39:56.964811 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:39:56.965055 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:39:56.965056 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:39:56.965100 (+ 44us) client_negotiation.cc:769] Sending connection context
0805 22:39:56.965159 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:39:56.965256 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260805 22:39:56.965747 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:56.957560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57288 (local address 127.19.77.188:35275)
0805 22:39:56.957619 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:56.957621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:56.957628 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:39:56.957652 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:56.957653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:56.957662 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:56.957702 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:56.958067 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.958809 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.959861 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:56.960193 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:56.960255 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:56.962498 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:56.962499 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:56.962500 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:56.962507 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:56.964241 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.964641 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.964642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.964643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.964693 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:56.964865 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:56.964866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:56.964866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:56.964986 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:56.965035 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:56.965564 (+ 529us) server_negotiation.cc:299] Negotiation successful
0805 22:39:56.965657 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:39:56.965658 1213 mvcc.cc:205] Tried to move back new op lower bound from 7315331469103120384 to 7315331469092777984. Current Snapshot: MvccSnapshot[applied={T|T < 7315331469103120384}]
I20260805 22:39:56.967834 1014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20: Bootstrap starting.
I20260805 22:39:56.968626 1014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:56.968943 1014 log.cc:824] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:56.969745 1014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20: No bootstrap required, opened a new log
I20260805 22:39:56.971751 1014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } }
I20260805 22:39:56.971910 1014 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:56.971952 1014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a23ee70aa7e4ee7b3d6861480c17c20, State: Initialized, Role: FOLLOWER
I20260805 22:39:56.972079 1014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } }
I20260805 22:39:56.972412 1014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:39:56.972453 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" is_pre_election: true
I20260805 22:39:56.972635 988 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4ed8bacb4645768d2f1dbc434b26c8 in term 0.
I20260805 22:39:56.972784 987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20"
I20260805 22:39:56.972851 987 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:39:56.973820 987 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4ed8bacb4645768d2f1dbc434b26c8 in term 1.
I20260805 22:39:56.974057 986 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [term 1 FOLLOWER]: Refusing update from remote peer fd4ed8bacb4645768d2f1dbc434b26c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:39:56.975076 1194 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:39:56.977916 1229 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:39:56.977982 1229 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:39:56.978080 1218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } } }
I20260805 22:39:56.978147 1218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:39:56.978199 1218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd4ed8bacb4645768d2f1dbc434b26c8. Latest consensus state: current_term: 1 leader_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } } }
I20260805 22:39:56.978247 1218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:39:56.978281 1218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } } }
I20260805 22:39:56.978327 1218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:39:56.984653 1231 mvcc.cc:205] Tried to move back new op lower bound from 7315331469103120384 to 7315331469092777984. Current Snapshot: MvccSnapshot[applied={T|T < 7315331469103120384}]
I20260805 22:39:57.002197 1194 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a23ee70aa7e4ee7b3d6861480c17c20" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35849 } } peers { permanent_uuid: "9e383bdf437b42299b2debb720d871c2" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 36107 } } peers { permanent_uuid: "fd4ed8bacb4645768d2f1dbc434b26c8" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35275 } } }
I20260805 22:39:57.002343 1194 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:39:57.004184 1210 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:39:57.005056 1210 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:39:57.018253 1210 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd4ed8bacb4645768d2f1dbc434b26c8: Generated new TSK 0
I20260805 22:39:57.018590 1210 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:39:57.945642 1207 catalog_manager.cc:1259] Loaded cluster ID: fa28273431dc428ca571118ca9346b05
I20260805 22:39:57.945734 1207 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2: loading cluster ID for follower catalog manager: success
I20260805 22:39:57.946568 1207 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2: acquiring CA information for follower catalog manager: success
I20260805 22:39:57.946895 1207 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9e383bdf437b42299b2debb720d871c2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:39:57.978478 1229 catalog_manager.cc:1259] Loaded cluster ID: fa28273431dc428ca571118ca9346b05
I20260805 22:39:57.978617 1229 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20: loading cluster ID for follower catalog manager: success
I20260805 22:39:57.979462 1229 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20: acquiring CA information for follower catalog manager: success
I20260805 22:39:57.979786 1229 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8a23ee70aa7e4ee7b3d6861480c17c20: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:39:58.084474 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 943
I20260805 22:39:58.091768 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 1022
I20260805 22:39:58.098300 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 1099
2026-08-05T22:39:58Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2926 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:39:58 dist-test-slave-chsk krb5kdc[1245](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:39:58 dist-test-slave-chsk krb5kdc[1245](info): set up 2 sockets
Aug 05 22:39:58 dist-test-slave-chsk krb5kdc[1245](info): commencing operation
krb5kdc: starting...
W20260805 22:39:59.158784 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:39:59 dist-test-slave-chsk krb5kdc[1245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:39:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:39:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:39:59.295444 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34587
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:34587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:39:59.380613 1258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:39:59.380906 1258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:39:59.380947 1258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:39:59.382192 1258 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:39:59.382280 1258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:39:59.382305 1258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:39:59.382325 1258 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:39:59.382352 1258 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:39:59.384028 1258 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:34587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:39:59.384369 1258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:39:59.384624 1258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:39:59.389871 1267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:39:59.389997 1264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:59.390234 1258 server_base.cc:1034] running on GCE node
W20260805 22:39:59.389925 1263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:39:59.390532 1258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:39:59.390862 1258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:39:59.392156 1258 hybrid_clock.cc:648] HybridClock initialized: now 1785969599392127 us; error 47 us; skew 500 ppm
Aug 05 22:39:59 dist-test-slave-chsk krb5kdc[1245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969599, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:39:59.395498 1258 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:39:59.396023 1258 webserver.cc:460] Webserver started at http://127.19.77.190:33225/ using document root <none> and password file <none>
I20260805 22:39:59.396296 1258 fs_manager.cc:359] Metadata directory not provided
I20260805 22:39:59.396373 1258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:39:59.396533 1258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:39:59.397748 1258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "60a72e820c2045a5af363b83ed14faa1"
format_stamp: "Formatted at 2026-08-05 22:39:59 on dist-test-slave-chsk"
server_key: "b2372b0bd9c62e8799249dae3c72b6f5"
server_key_iv: "93d8f81017193d7918480caaa9842d01"
server_key_version: "encryptionkey@0"
I20260805 22:39:59.398129 1258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "60a72e820c2045a5af363b83ed14faa1"
format_stamp: "Formatted at 2026-08-05 22:39:59 on dist-test-slave-chsk"
server_key: "b2372b0bd9c62e8799249dae3c72b6f5"
server_key_iv: "93d8f81017193d7918480caaa9842d01"
server_key_version: "encryptionkey@0"
I20260805 22:39:59.399927 1258 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260805 22:39:59.400857 1274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:39:59.401196 1258 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:39:59.401468 1258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "60a72e820c2045a5af363b83ed14faa1"
format_stamp: "Formatted at 2026-08-05 22:39:59 on dist-test-slave-chsk"
server_key: "b2372b0bd9c62e8799249dae3c72b6f5"
server_key_iv: "93d8f81017193d7918480caaa9842d01"
server_key_version: "encryptionkey@0"
I20260805 22:39:59.401599 1258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:39:59.424079 1258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:39:59.426271 1258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:39:59.426405 1258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:39:59.430892 1258 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:34587
I20260805 22:39:59.430981 1326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:34587 every 8 connection(s)
I20260805 22:39:59.431375 1258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:39:59.431981 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 1258
I20260805 22:39:59.432109 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:39:59.432320 19766 external_mini_cluster.cc:1428] Setting key 981d0121f3ec04adb30eb78416589cdf
I20260805 22:39:59.432538 1327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:39:59.436400 1327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1: Bootstrap starting.
I20260805 22:39:59.437170 1327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1: Neither blocks nor log segments found. Creating new log.
I20260805 22:39:59.437505 1327 log.cc:824] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:39:59.438426 1327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1: No bootstrap required, opened a new log
Aug 05 22:39:59 dist-test-slave-chsk krb5kdc[1245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:39:59.440944 1327 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a72e820c2045a5af363b83ed14faa1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34587 } }
I20260805 22:39:59.441160 1327 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:39:59.441203 1327 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a72e820c2045a5af363b83ed14faa1, State: Initialized, Role: FOLLOWER
I20260805 22:39:59.441354 1327 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a72e820c2045a5af363b83ed14faa1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34587 } }
I20260805 22:39:59.441445 1327 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:39:59.441504 1327 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:39:59.441563 1327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:39:59.442487 1327 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a72e820c2045a5af363b83ed14faa1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34587 } }
I20260805 22:39:59.442605 1327 leader_election.cc:302] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60a72e820c2045a5af363b83ed14faa1; no voters:
I20260805 22:39:59.442821 1327 leader_election.cc:288] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:39:59.442879 1332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:39:59.443091 1332 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [term 1 LEADER]: Becoming Leader. State: Replica: 60a72e820c2045a5af363b83ed14faa1, State: Running, Role: LEADER
I20260805 22:39:59.443100 1327 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:39:59.443243 1332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a72e820c2045a5af363b83ed14faa1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34587 } }
I20260805 22:39:59.443606 1332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60a72e820c2045a5af363b83ed14faa1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a72e820c2045a5af363b83ed14faa1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34587 } } }
I20260805 22:39:59.443691 1332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:39:59.443819 1332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60a72e820c2045a5af363b83ed14faa1. Latest consensus state: current_term: 1 leader_uuid: "60a72e820c2045a5af363b83ed14faa1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a72e820c2045a5af363b83ed14faa1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34587 } } }
I20260805 22:39:59.443878 1332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:39:59.444685 1339 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:39:59.445240 1339 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:39:59.445691 1330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:39:59.432905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41590 (local address 127.19.77.190:34587)
0805 22:39:59.433125 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0805 22:39:59.433135 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:39:59.433172 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:39:59.433873 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:39:59.433882 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:39:59.433951 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:39:59.434113 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:39:59.434750 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:59.436182 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:59.437089 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:39:59.437746 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:39:59.437850 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:39:59.440970 (+ 3120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:39:59.440975 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:39:59.440975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:39:59.440990 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:39:59.443377 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:59.443917 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:59.443921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:59.443921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:59.444046 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:39:59.444329 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:39:59.444330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:39:59.444330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:39:59.444668 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:39:59.444810 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0805 22:39:59.445334 (+ 524us) server_negotiation.cc:299] Negotiation successful
0805 22:39:59.445491 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":99,"threads_started":1}
I20260805 22:39:59.446874 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:39:59.446935 1339 catalog_manager.cc:1347] Generated new cluster ID: e95fed1f9c0748ad88aa4defd2495617
I20260805 22:39:59.446979 1339 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:39:59.470043 1339 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:39:59.470691 1339 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:39:59.476831 1339 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60a72e820c2045a5af363b83ed14faa1: Generated new TSK 0
I20260805 22:39:59.477106 1339 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:39:59.501467 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 1258
2026-08-05T22:39:59Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1401 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:39:59 dist-test-slave-chsk krb5kdc[1354](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:39:59 dist-test-slave-chsk krb5kdc[1354](info): set up 2 sockets
Aug 05 22:39:59 dist-test-slave-chsk krb5kdc[1354](info): commencing operation
krb5kdc: starting...
W20260805 22:40:00.570869 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:40:00 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:40:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:40:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:40:00.707463 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:41221
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:41221
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:00.794440 1367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:00.794721 1367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:00.794764 1367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:00.796049 1367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:40:00.796129 1367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:00.796154 1367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:00.796178 1367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:40:00.796221 1367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:40:00.797865 1367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:41221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:41221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:00.798193 1367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:00.798446 1367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:00.803506 1372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:00.803489 1375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:00.803474 1373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:00.803889 1367 server_base.cc:1034] running on GCE node
I20260805 22:40:00.804123 1367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:00.804394 1367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:00.805584 1367 hybrid_clock.cc:648] HybridClock initialized: now 1785969600805571 us; error 32 us; skew 500 ppm
Aug 05 22:40:00 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969600, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:00.808758 1367 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:40:00.809247 1367 webserver.cc:460] Webserver started at http://127.19.77.190:43343/ using document root <none> and password file <none>
I20260805 22:40:00.809511 1367 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:00.809587 1367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:00.809742 1367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:40:00.810863 1367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "41ffc861886c4f3a9237dabb0f2060b7"
format_stamp: "Formatted at 2026-08-05 22:40:00 on dist-test-slave-chsk"
server_key: "12a0bb9e9bdb0958ddff37575a2bba27"
server_key_iv: "691c3e7240d827281bfc3ad9ef646cdb"
server_key_version: "encryptionkey@0"
I20260805 22:40:00.811309 1367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "41ffc861886c4f3a9237dabb0f2060b7"
format_stamp: "Formatted at 2026-08-05 22:40:00 on dist-test-slave-chsk"
server_key: "12a0bb9e9bdb0958ddff37575a2bba27"
server_key_iv: "691c3e7240d827281bfc3ad9ef646cdb"
server_key_version: "encryptionkey@0"
I20260805 22:40:00.812774 1367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:00.813858 1383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:00.814231 1367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:00.814345 1367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "41ffc861886c4f3a9237dabb0f2060b7"
format_stamp: "Formatted at 2026-08-05 22:40:00 on dist-test-slave-chsk"
server_key: "12a0bb9e9bdb0958ddff37575a2bba27"
server_key_iv: "691c3e7240d827281bfc3ad9ef646cdb"
server_key_version: "encryptionkey@0"
I20260805 22:40:00.814440 1367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:00.838810 1367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:00.841100 1367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:00.841310 1367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:00.845692 1367 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:41221
I20260805 22:40:00.845743 1436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:41221 every 8 connection(s)
I20260805 22:40:00.846155 1367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:40:00.847294 1437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:00.849766 1437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Bootstrap starting.
I20260805 22:40:00.850419 1437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:00.850745 1437 log.cc:824] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:00.851663 1437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: No bootstrap required, opened a new log
I20260805 22:40:00.853420 1437 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:00.853581 1437 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:00.853606 1437 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41ffc861886c4f3a9237dabb0f2060b7, State: Initialized, Role: FOLLOWER
I20260805 22:40:00.853777 1437 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:00.853845 1437 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:40:00.853868 1437 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:40:00.853936 1437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:00.854197 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 1367
I20260805 22:40:00.854337 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:40:00.854548 19766 external_mini_cluster.cc:1428] Setting key 388a91b4b1f12372f7d51d7d7001900d
I20260805 22:40:00.855283 1437 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:00.855434 1437 leader_election.cc:302] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41ffc861886c4f3a9237dabb0f2060b7; no voters:
I20260805 22:40:00.855602 1437 leader_election.cc:288] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:40:00.855651 1442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:40:00.855803 1442 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 1 LEADER]: Becoming Leader. State: Replica: 41ffc861886c4f3a9237dabb0f2060b7, State: Running, Role: LEADER
I20260805 22:40:00.855877 1437 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:40:00.855952 1442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:00.856326 1442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41ffc861886c4f3a9237dabb0f2060b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } } }
I20260805 22:40:00.856475 1442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:40:00.856665 1442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41ffc861886c4f3a9237dabb0f2060b7. Latest consensus state: current_term: 1 leader_uuid: "41ffc861886c4f3a9237dabb0f2060b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } } }
I20260805 22:40:00.856786 1442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:40:00.857208 1450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:40:00.857782 1450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:40:00.861825 1450 catalog_manager.cc:1347] Generated new cluster ID: 48aab26df6d6418abbc7adce47950bcd
I20260805 22:40:00.861894 1450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:40:00 dist-test-slave-chsk krb5kdc[1354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:00.867619 1441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:00.855131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47528 (local address 127.19.77.190:41221)
0805 22:40:00.855409 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:00.855419 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:00.855470 (+ 51us) server_negotiation.cc:407] Connection header received
0805 22:40:00.855607 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:00.855614 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:00.855680 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:00.855838 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:00.856645 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:00.858045 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:00.859101 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:00.859658 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:00.859804 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:00.862956 (+ 3152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:00.862961 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:00.862961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:00.862974 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:00.865706 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:00.866213 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:00.866216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:00.866216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:00.866356 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:00.866591 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:00.866591 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:00.866592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:00.866907 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:00.867065 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:00.867222 (+ 157us) server_negotiation.cc:299] Negotiation successful
0805 22:40:00.867371 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":122,"threads_started":1}
I20260805 22:40:00.875489 1450 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:40:00.876502 1450 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:40:00.882138 1450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Generated new TSK 0
I20260805 22:40:00.882357 1450 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:40:00.914309 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:41221
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:01.003719 1463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:01.003949 1463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:01.003978 1463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:01.005213 1463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:01.005264 1463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:01.005292 1463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:40:01.006848 1463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:41221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:01.007184 1463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:01.007455 1463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:01.013459 1469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:01.013463 1470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:01.013460 1472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:01.013773 1463 server_base.cc:1034] running on GCE node
I20260805 22:40:01.014014 1463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:01.014263 1463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:01.015396 1463 hybrid_clock.cc:648] HybridClock initialized: now 1785969601015371 us; error 47 us; skew 500 ppm
Aug 05 22:40:01 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:01.018216 1463 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:40:01.018776 1463 webserver.cc:460] Webserver started at http://127.19.77.129:45141/ using document root <none> and password file <none>
I20260805 22:40:01.019039 1463 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:01.019116 1463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:01.019338 1463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:40:01.020561 1463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "639af51b483348a2878b35e1b1996667"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "27448744687b195fe9f53fa1e73e7de5"
server_key_iv: "3caa43c6febf122d4f95270e77af9966"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.020951 1463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "639af51b483348a2878b35e1b1996667"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "27448744687b195fe9f53fa1e73e7de5"
server_key_iv: "3caa43c6febf122d4f95270e77af9966"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.022461 1463 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:40:01.023407 1480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.023618 1463 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:01.023742 1463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "639af51b483348a2878b35e1b1996667"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "27448744687b195fe9f53fa1e73e7de5"
server_key_iv: "3caa43c6febf122d4f95270e77af9966"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.023839 1463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:01.043375 1463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:01.045733 1463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:01.045943 1463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:01.046236 1463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:01.046595 1463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:01.046669 1463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.046718 1463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:01.046744 1463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.054168 1463 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:34435
I20260805 22:40:01.054239 1595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:34435 every 8 connection(s)
I20260805 22:40:01.054580 1463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:40:01.061264 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 1463
I20260805 22:40:01.061383 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
Aug 05 22:40:01 dist-test-slave-chsk krb5kdc[1354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:01.061619 19766 external_mini_cluster.cc:1428] Setting key 0d6ead6e42513375c3df158bcd1457cf
I20260805 22:40:01.065622 1441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.055389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:34897 (local address 127.19.77.190:41221)
0805 22:40:01.055436 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:01.055445 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:01.055695 (+ 250us) server_negotiation.cc:407] Connection header received
0805 22:40:01.056284 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:01.056285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:01.056302 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:01.056396 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:01.057502 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.058106 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.059205 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.059430 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.059520 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.062197 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:01.062198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:01.062198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:01.062206 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:01.063899 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:01.064503 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:01.064504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:01.064504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:01.064578 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:01.064847 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:01.064847 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:01.064848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:01.065014 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:01.065094 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:01.065426 (+ 332us) server_negotiation.cc:299] Negotiation successful
0805 22:40:01.065550 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:40:01.065883 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.055384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:34897)
0805 22:40:01.055563 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:01.055604 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:01.056165 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:01.056474 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:01.056478 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:01.057166 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:01.057379 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.057385 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.058214 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.058215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.059070 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.059073 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.059535 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.059536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.059670 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.060368 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:01.060378 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:01.062094 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:01.064001 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:01.064013 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:01.064016 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:01.064394 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:01.064659 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:01.064659 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:01.064659 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:01.064776 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:01.065118 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:01.065126 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:01.065275 (+ 149us) client_negotiation.cc:769] Sending connection context
0805 22:40:01.065377 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 22:40:01.065584 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
I20260805 22:40:01.066504 1596 heartbeater.cc:347] Connected to a master server at 127.19.77.190:41221
I20260805 22:40:01.066624 1596 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:01.066846 1596 heartbeater.cc:511] Master 127.19.77.190:41221 requested a full tablet report, sending...
I20260805 22:40:01.067570 1400 ts_manager.cc:194] Registered new tserver with Master: 639af51b483348a2878b35e1b1996667 (127.19.77.129:34435)
I20260805 22:40:01.068522 1400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:34897
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:40:01.095569 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:41221
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:01.182505 1601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:01.182847 1601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:01.182896 1601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:01.185207 1601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:01.185288 1601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:01.185343 1601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:40:01.187997 1601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:41221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:01.188377 1601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:01.188699 1601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:01.194860 1606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:01.194855 1607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:01.194825 1609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:01.194952 1601 server_base.cc:1034] running on GCE node
I20260805 22:40:01.195339 1601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:01.195652 1601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:01.196831 1601 hybrid_clock.cc:648] HybridClock initialized: now 1785969601196807 us; error 40 us; skew 500 ppm
Aug 05 22:40:01 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:01.204249 1601 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:40:01.204793 1601 webserver.cc:460] Webserver started at http://127.19.77.130:45501/ using document root <none> and password file <none>
I20260805 22:40:01.205077 1601 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:01.205166 1601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:01.205332 1601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:40:01.206511 1601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "3746194b135640ee8c45ff71e8b36bcc"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "ed95543e8fc75be5b46b04d256ca3e90"
server_key_iv: "c8a8be1c37c1ec1ebec95abce6694c4d"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.206916 1601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "3746194b135640ee8c45ff71e8b36bcc"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "ed95543e8fc75be5b46b04d256ca3e90"
server_key_iv: "c8a8be1c37c1ec1ebec95abce6694c4d"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.208519 1601 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:40:01.209461 1616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.209703 1601 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:01.209812 1601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "3746194b135640ee8c45ff71e8b36bcc"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "ed95543e8fc75be5b46b04d256ca3e90"
server_key_iv: "c8a8be1c37c1ec1ebec95abce6694c4d"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.209916 1601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:01.227638 1601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:01.230419 1601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:01.230564 1601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:01.230769 1601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:01.231113 1601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:01.231211 1601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.231256 1601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:01.231284 1601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.237684 1601 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:38899
I20260805 22:40:01.237767 1732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:38899 every 8 connection(s)
I20260805 22:40:01.238116 1601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:40:01.242436 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 1601
I20260805 22:40:01.242552 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:40:01.242784 19766 external_mini_cluster.cc:1428] Setting key c7bf7e14a5ed71cf9e412ef87ce014ba
Aug 05 22:40:01 dist-test-slave-chsk krb5kdc[1354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:01.249286 1441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.239307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:36507 (local address 127.19.77.190:41221)
0805 22:40:01.239382 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:01.239385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:01.239720 (+ 335us) server_negotiation.cc:407] Connection header received
0805 22:40:01.240347 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:01.240348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:01.240360 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:01.240421 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:01.241461 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.241993 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.243370 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.243677 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.243757 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.246198 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:01.246201 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:01.246201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:01.246210 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:01.247670 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:01.248152 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:01.248153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:01.248154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:01.248220 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:01.248548 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:01.248549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:01.248549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:01.248683 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:01.248763 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:01.249083 (+ 320us) server_negotiation.cc:299] Negotiation successful
0805 22:40:01.249190 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:40:01.249495 1735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.239344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:36507)
0805 22:40:01.239544 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:01.239584 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:01.240229 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:01.240512 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:01.240515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:01.241144 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:01.241360 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.241365 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.242107 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.242108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.243268 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.243271 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.243770 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.243772 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.243918 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.244550 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:01.244559 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:01.246073 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:01.247777 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:01.247789 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:01.247791 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:01.248050 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:01.248293 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:01.248294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:01.248295 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:01.248463 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:01.248765 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:01.248774 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:01.248929 (+ 155us) client_negotiation.cc:769] Sending connection context
0805 22:40:01.249042 (+ 113us) client_negotiation.cc:240] Negotiation successful
0805 22:40:01.249225 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":104,"threads_started":1}
I20260805 22:40:01.250283 1733 heartbeater.cc:347] Connected to a master server at 127.19.77.190:41221
I20260805 22:40:01.250430 1733 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:01.250674 1733 heartbeater.cc:511] Master 127.19.77.190:41221 requested a full tablet report, sending...
I20260805 22:40:01.251194 1400 ts_manager.cc:194] Registered new tserver with Master: 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899)
I20260805 22:40:01.251607 1400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:36507
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:40:01.272294 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:41221
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:01.364598 1738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:01.364827 1738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:01.364854 1738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:01.366056 1738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:01.366106 1738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:01.366135 1738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:40:01.367727 1738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:41221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:01.368017 1738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:01.368292 1738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:01.373616 1744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:01.373610 1746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:01.373608 1743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:01.373869 1738 server_base.cc:1034] running on GCE node
I20260805 22:40:01.374131 1738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:01.374408 1738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:01.375552 1738 hybrid_clock.cc:648] HybridClock initialized: now 1785969601375534 us; error 37 us; skew 500 ppm
Aug 05 22:40:01 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:01.378242 1738 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:40:01.378726 1738 webserver.cc:460] Webserver started at http://127.19.77.131:43349/ using document root <none> and password file <none>
I20260805 22:40:01.379012 1738 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:01.379063 1738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:01.379246 1738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:40:01.380393 1738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "11cce5d94c824aad8dc6974f6e29dd2d"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "5c3d8eaae8d52acd5e006e744c219b9c"
server_key_iv: "c596d48a64fec89958a9e9b94d35d3be"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.380788 1738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "11cce5d94c824aad8dc6974f6e29dd2d"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "5c3d8eaae8d52acd5e006e744c219b9c"
server_key_iv: "c596d48a64fec89958a9e9b94d35d3be"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.382333 1738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:40:01.383270 1753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.383481 1738 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:01.383559 1738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "11cce5d94c824aad8dc6974f6e29dd2d"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "5c3d8eaae8d52acd5e006e744c219b9c"
server_key_iv: "c596d48a64fec89958a9e9b94d35d3be"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.383670 1738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:01.393450 1738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:01.395828 1738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:01.396030 1738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:01.396335 1738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:01.396688 1738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:01.396726 1738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.396749 1738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:01.396762 1738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.403405 1738 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:43041
I20260805 22:40:01.403452 1868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:43041 every 8 connection(s)
I20260805 22:40:01.403807 1738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:40:01.408703 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 1738
I20260805 22:40:01.408819 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:40:01.409044 19766 external_mini_cluster.cc:1428] Setting key 7617a480c2ff00e7742a445e660bb1b6
Aug 05 22:40:01 dist-test-slave-chsk krb5kdc[1354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:01.414265 1441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.404642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:49153 (local address 127.19.77.190:41221)
0805 22:40:01.404708 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:01.404710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:01.404915 (+ 205us) server_negotiation.cc:407] Connection header received
0805 22:40:01.405490 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:01.405491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:01.405500 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:01.405569 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:01.406524 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.407023 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.408137 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.408363 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.408455 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.411211 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:01.411212 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:01.411212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:01.411220 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:01.412744 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:01.413210 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:01.413211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:01.413211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:01.413274 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:01.413571 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:01.413571 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:01.413572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:01.413702 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:01.413781 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:01.414072 (+ 291us) server_negotiation.cc:299] Negotiation successful
0805 22:40:01.414160 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:40:01.414486 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.404605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:49153)
0805 22:40:01.404777 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:01.404821 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:01.405399 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:01.405638 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:01.405641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:01.406226 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:01.406428 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.406432 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.407114 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.407114 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.408053 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.408056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.408552 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.408554 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.408736 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.409458 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:01.409467 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:01.411051 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:01.412841 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:01.412851 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:01.412854 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:01.413101 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:01.413347 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:01.413348 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:01.413348 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:01.413493 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:01.413772 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:01.413779 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:01.413933 (+ 154us) client_negotiation.cc:769] Sending connection context
0805 22:40:01.414048 (+ 115us) client_negotiation.cc:240] Negotiation successful
0805 22:40:01.414238 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260805 22:40:01.414999 1869 heartbeater.cc:347] Connected to a master server at 127.19.77.190:41221
I20260805 22:40:01.415091 1869 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:01.415313 1869 heartbeater.cc:511] Master 127.19.77.190:41221 requested a full tablet report, sending...
I20260805 22:40:01.415680 1400 ts_manager.cc:194] Registered new tserver with Master: 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041)
I20260805 22:40:01.416081 1400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:49153
I20260805 22:40:01.420842 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:40:01.429045 1441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.422330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47544 (local address 127.19.77.190:41221)
0805 22:40:01.422401 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:01.422404 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:01.422544 (+ 140us) server_negotiation.cc:407] Connection header received
0805 22:40:01.422597 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:01.422598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:01.422608 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:01.422667 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:01.423356 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.423856 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.424575 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.424771 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.424829 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.426033 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:01.426035 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:01.426035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:01.426042 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:01.427798 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:01.428228 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:01.428230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:01.428230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:01.428292 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:01.428429 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:01.428429 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:01.428430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:01.428585 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:01.428749 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:01.428796 (+ 47us) server_negotiation.cc:299] Negotiation successful
0805 22:40:01.428912 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:40:01.430750 1400 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:40:01.432538 1400 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:40:01.439956 1884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.435236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59752 (local address 127.19.77.130:38899)
0805 22:40:01.435450 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:01.435470 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:01.435481 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:40:01.435525 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:01.435528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:01.435545 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:01.435642 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:01.435861 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.437056 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.438509 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.439317 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.439407 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.439478 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:01.439787 (+ 309us) server_negotiation.cc:299] Negotiation successful
0805 22:40:01.439842 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":91,"threads_started":1}
I20260805 22:40:01.439945 1882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.434997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:34435 (local address 127.0.0.1:50550)
0805 22:40:01.435233 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:01.435268 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:01.435335 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:01.435863 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:01.435864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:01.435866 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:01.435905 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.435907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.437177 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.437177 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.438583 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.438586 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.439679 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.439680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.439755 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.439759 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:40:01.439817 (+ 58us) client_negotiation.cc:240] Negotiation successful
0805 22:40:01.439864 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":129,"thread_start_us":87,"threads_started":1}
I20260805 22:40:01.439945 1883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.434997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:38899 (local address 127.0.0.1:59752)
0805 22:40:01.435215 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:01.435258 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:01.435335 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:01.435666 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:01.435669 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:01.435671 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:01.435746 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.435754 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.437206 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.437207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.438390 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.438393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.439419 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.439420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.439528 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.439655 (+ 127us) client_negotiation.cc:769] Sending connection context
0805 22:40:01.439758 (+ 103us) client_negotiation.cc:240] Negotiation successful
0805 22:40:01.439842 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":114,"thread_start_us":64,"threads_started":1}
I20260805 22:40:01.440481 1885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.435379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50550 (local address 127.19.77.129:34435)
0805 22:40:01.435577 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:01.435583 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:01.435594 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:40:01.435647 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:01.435649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:01.435666 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:01.435785 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:01.435998 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.437091 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.438681 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.439408 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.439526 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.439588 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:01.440322 (+ 734us) server_negotiation.cc:299] Negotiation successful
0805 22:40:01.440378 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":129,"threads_started":1}
I20260805 22:40:01.440585 1881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.435012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:43041 (local address 127.0.0.1:56498)
0805 22:40:01.435438 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:01.435449 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:01.435490 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:01.436157 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:01.436158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:01.436160 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:01.436209 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.436210 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.437121 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.437122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.438585 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.438586 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.440316 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.440317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.440387 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.440392 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:40:01.440452 (+ 60us) client_negotiation.cc:240] Negotiation successful
0805 22:40:01.440496 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":80,"thread_start_us":128,"threads_started":1}
I20260805 22:40:01.440670 1886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.435619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56498 (local address 127.19.77.131:43041)
0805 22:40:01.435832 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:01.435836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:01.435925 (+ 89us) server_negotiation.cc:407] Connection header received
0805 22:40:01.435970 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:01.435972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:01.435987 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:01.436062 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:01.436289 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.437006 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.439237 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.440120 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.440204 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.440274 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:01.440487 (+ 213us) server_negotiation.cc:299] Negotiation successful
0805 22:40:01.440547 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":95,"threads_started":1}
I20260805 22:40:01.441196 1665 tablet_service.cc:1467] Processing CreateTablet for tablet 8889301e145f4c7e9277bdf0879fc23a (DEFAULT_TABLE table=test-table [id=39ef9b613c864a12af1c02656213293c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:01.441310 1529 tablet_service.cc:1467] Processing CreateTablet for tablet 8889301e145f4c7e9277bdf0879fc23a (DEFAULT_TABLE table=test-table [id=39ef9b613c864a12af1c02656213293c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:01.441634 1665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8889301e145f4c7e9277bdf0879fc23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:01.441648 1529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8889301e145f4c7e9277bdf0879fc23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:01.443691 1803 tablet_service.cc:1467] Processing CreateTablet for tablet 8889301e145f4c7e9277bdf0879fc23a (DEFAULT_TABLE table=test-table [id=39ef9b613c864a12af1c02656213293c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:01.444164 1803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8889301e145f4c7e9277bdf0879fc23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:01.444797 1887 tablet_bootstrap.cc:492] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Bootstrap starting.
I20260805 22:40:01.445032 1888 tablet_bootstrap.cc:492] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: Bootstrap starting.
I20260805 22:40:01.445478 1887 tablet_bootstrap.cc:654] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:01.445741 1888 tablet_bootstrap.cc:654] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:01.446097 1887 log.cc:824] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:01.446374 1888 log.cc:824] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:01.446949 1887 tablet_bootstrap.cc:492] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: No bootstrap required, opened a new log
I20260805 22:40:01.447037 1887 ts_tablet_manager.cc:1397] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:40:01.447193 1888 tablet_bootstrap.cc:492] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: No bootstrap required, opened a new log
I20260805 22:40:01.447268 1888 ts_tablet_manager.cc:1397] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:40:01.447988 1891 tablet_bootstrap.cc:492] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: Bootstrap starting.
I20260805 22:40:01.448693 1891 tablet_bootstrap.cc:654] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:01.449301 1891 log.cc:824] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:01.449397 1887 raft_consensus.cc:348] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:01.449426 1888 raft_consensus.cc:348] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:01.449601 1887 raft_consensus.cc:374] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:01.449601 1888 raft_consensus.cc:374] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:01.449646 1887 raft_consensus.cc:729] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 639af51b483348a2878b35e1b1996667, State: Initialized, Role: FOLLOWER
I20260805 22:40:01.449646 1888 raft_consensus.cc:729] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3746194b135640ee8c45ff71e8b36bcc, State: Initialized, Role: FOLLOWER
I20260805 22:40:01.449774 1888 consensus_queue.cc:260] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:01.449802 1887 consensus_queue.cc:260] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:01.450110 1888 ts_tablet_manager.cc:1428] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:40:01.450110 1887 ts_tablet_manager.cc:1428] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:40:01.450155 1891 tablet_bootstrap.cc:492] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: No bootstrap required, opened a new log
I20260805 22:40:01.450245 1733 heartbeater.cc:503] Master 127.19.77.190:41221 was elected leader, sending a full tablet report...
I20260805 22:40:01.450253 1891 ts_tablet_manager.cc:1397] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:40:01.450569 1596 heartbeater.cc:503] Master 127.19.77.190:41221 was elected leader, sending a full tablet report...
I20260805 22:40:01.452395 1891 raft_consensus.cc:348] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:01.452581 1891 raft_consensus.cc:374] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:01.452632 1891 raft_consensus.cc:729] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11cce5d94c824aad8dc6974f6e29dd2d, State: Initialized, Role: FOLLOWER
I20260805 22:40:01.452765 1891 consensus_queue.cc:260] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:01.453061 1891 ts_tablet_manager.cc:1428] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:40:01.453105 1869 heartbeater.cc:503] Master 127.19.77.190:41221 was elected leader, sending a full tablet report...
W20260805 22:40:01.488757 1734 tablet.cc:2369] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:40:01.555498 1597 tablet.cc:2369] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:40:01.624521 1894 raft_consensus.cc:482] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:40:01.624665 1894 raft_consensus.cc:504] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:01.625078 1894 leader_election.cc:288] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899), 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041)
I20260805 22:40:01.629546 1884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.625410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:33429 (local address 127.19.77.130:38899)
0805 22:40:01.625462 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:01.625464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:01.625601 (+ 137us) server_negotiation.cc:407] Connection header received
0805 22:40:01.625676 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:01.625677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:01.625691 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:01.625748 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:01.625981 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.626769 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.628527 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.629136 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.629226 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.629235 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:01.629424 (+ 189us) server_negotiation.cc:299] Negotiation successful
0805 22:40:01.629466 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:40:01.629545 1886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.625425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:54903 (local address 127.19.77.131:43041)
0805 22:40:01.625469 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:01.625470 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:01.625601 (+ 131us) server_negotiation.cc:407] Connection header received
0805 22:40:01.625676 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:01.625677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:01.625688 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:01.625748 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:01.625981 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.626766 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.628525 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.629146 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.629227 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.629235 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:01.629424 (+ 189us) server_negotiation.cc:299] Negotiation successful
0805 22:40:01.629466 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:40:01.629608 1897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.625317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:43041 (local address 127.19.77.129:54903)
0805 22:40:01.625509 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:01.625518 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:01.625596 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:01.625772 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:01.625772 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:01.625775 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:01.625904 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.625906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.626875 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.626875 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.628408 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.628412 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.629240 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.629241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.629326 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.629334 (+ 8us) client_negotiation.cc:769] Sending connection context
0805 22:40:01.629396 (+ 62us) client_negotiation.cc:240] Negotiation successful
0805 22:40:01.629456 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":153,"thread_start_us":82,"threads_started":1}
I20260805 22:40:01.629608 1896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.625317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:38899 (local address 127.19.77.129:33429)
0805 22:40:01.625504 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:01.625518 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:01.625595 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:01.625772 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:01.625772 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:01.625776 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:01.625899 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.625901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.626874 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.626875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.628418 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:01.628420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.629241 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.629242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:01.629326 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.629333 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 22:40:01.629396 (+ 63us) client_negotiation.cc:240] Negotiation successful
0805 22:40:01.629456 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":167,"thread_start_us":85,"threads_started":1}
I20260805 22:40:01.630081 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8889301e145f4c7e9277bdf0879fc23a" candidate_uuid: "639af51b483348a2878b35e1b1996667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" is_pre_election: true
I20260805 22:40:01.630084 1685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8889301e145f4c7e9277bdf0879fc23a" candidate_uuid: "639af51b483348a2878b35e1b1996667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3746194b135640ee8c45ff71e8b36bcc" is_pre_election: true
I20260805 22:40:01.630286 1823 raft_consensus.cc:2454] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 639af51b483348a2878b35e1b1996667 in term 0.
I20260805 22:40:01.630295 1685 raft_consensus.cc:2454] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 639af51b483348a2878b35e1b1996667 in term 0.
I20260805 22:40:01.630564 1482 leader_election.cc:302] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3746194b135640ee8c45ff71e8b36bcc, 639af51b483348a2878b35e1b1996667; no voters:
I20260805 22:40:01.630712 1894 raft_consensus.cc:2781] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:40:01.630772 1894 raft_consensus.cc:482] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:40:01.630795 1894 raft_consensus.cc:3037] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:01.631698 1894 raft_consensus.cc:504] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:01.631871 1894 leader_election.cc:288] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 1 election: Requested vote from peers 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899), 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041)
I20260805 22:40:01.632088 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8889301e145f4c7e9277bdf0879fc23a" candidate_uuid: "639af51b483348a2878b35e1b1996667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11cce5d94c824aad8dc6974f6e29dd2d"
I20260805 22:40:01.632189 1823 raft_consensus.cc:3037] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:01.632952 1823 raft_consensus.cc:2454] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 639af51b483348a2878b35e1b1996667 in term 1.
I20260805 22:40:01.633109 1685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8889301e145f4c7e9277bdf0879fc23a" candidate_uuid: "639af51b483348a2878b35e1b1996667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3746194b135640ee8c45ff71e8b36bcc"
I20260805 22:40:01.633200 1483 leader_election.cc:302] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11cce5d94c824aad8dc6974f6e29dd2d, 639af51b483348a2878b35e1b1996667; no voters:
I20260805 22:40:01.633211 1685 raft_consensus.cc:3037] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:01.633332 1894 raft_consensus.cc:2781] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:40:01.633546 1894 raft_consensus.cc:686] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 1 LEADER]: Becoming Leader. State: Replica: 639af51b483348a2878b35e1b1996667, State: Running, Role: LEADER
I20260805 22:40:01.633656 1894 consensus_queue.cc:237] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:01.634419 1685 raft_consensus.cc:2454] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 639af51b483348a2878b35e1b1996667 in term 1.
I20260805 22:40:01.634670 1400 catalog_manager.cc:5495] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 639af51b483348a2878b35e1b1996667 (127.19.77.129). New cstate: current_term: 1 leader_uuid: "639af51b483348a2878b35e1b1996667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } health_report { overall_health: UNKNOWN } } }
W20260805 22:40:01.654497 1870 tablet.cc:2369] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:40:01.668138 1885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.665567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50556 (local address 127.19.77.129:34435)
0805 22:40:01.665651 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:01.665653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:01.665671 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:40:01.665712 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:01.665713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:01.665735 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:01.665807 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:40:01.665957 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.666428 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.667224 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:01.667419 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:01.667480 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:01.667676 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:40:01.667795 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:40:01.667862 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:01.667988 (+ 126us) server_negotiation.cc:299] Negotiation successful
0805 22:40:01.668011 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260805 22:40:01.670205 1685 raft_consensus.cc:1261] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc [term 1 FOLLOWER]: Refusing update from remote peer 639af51b483348a2878b35e1b1996667: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:40:01.670205 1823 raft_consensus.cc:1261] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d [term 1 FOLLOWER]: Refusing update from remote peer 639af51b483348a2878b35e1b1996667: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:40:01.670634 1898 consensus_queue.cc:1035] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:40:01.670814 1894 consensus_queue.cc:1035] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:40:01.674125 1903 mvcc.cc:205] Tried to move back new op lower bound from 7315331488438063104 to 7315331488292184064. Current Snapshot: MvccSnapshot[applied={T|T < 7315331488438063104 or (T in {7315331488438063104})}]
I20260805 22:40:01.676270 1400 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:40:01.676397 1400 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:40:01.677320 1400 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Sending DeleteTablet for 3 replicas of tablet 8889301e145f4c7e9277bdf0879fc23a
I20260805 22:40:01.677685 1529 tablet_service.cc:1514] Processing DeleteTablet for tablet 8889301e145f4c7e9277bdf0879fc23a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:01 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:50550
I20260805 22:40:01.677796 1665 tablet_service.cc:1514] Processing DeleteTablet for tablet 8889301e145f4c7e9277bdf0879fc23a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:01 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:59752
I20260805 22:40:01.677877 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 1463
I20260805 22:40:01.677963 1803 tablet_service.cc:1514] Processing DeleteTablet for tablet 8889301e145f4c7e9277bdf0879fc23a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:01 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:56498
I20260805 22:40:01.680487 1911 tablet_replica.cc:330] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: stopping tablet replica
I20260805 22:40:01.680639 1911 raft_consensus.cc:2229] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:40:01.680778 1911 raft_consensus.cc:2258] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:01.681070 1912 tablet_replica.cc:330] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: stopping tablet replica
I20260805 22:40:01.681218 1912 raft_consensus.cc:2229] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:40:01.681360 1912 raft_consensus.cc:2258] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:01.681399 1911 ts_tablet_manager.cc:1905] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:01.681795 1912 ts_tablet_manager.cc:1905] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:01.683714 1912 ts_tablet_manager.cc:1918] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:40:01.683707 1911 ts_tablet_manager.cc:1918] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:40:01.683821 1912 log.cc:1196] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/8889301e145f4c7e9277bdf0879fc23a
I20260805 22:40:01.683821 1911 log.cc:1196] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/8889301e145f4c7e9277bdf0879fc23a
I20260805 22:40:01.684118 1912 ts_tablet_manager.cc:1939] T 8889301e145f4c7e9277bdf0879fc23a P 11cce5d94c824aad8dc6974f6e29dd2d: Deleting consensus metadata
I20260805 22:40:01.684149 1911 ts_tablet_manager.cc:1939] T 8889301e145f4c7e9277bdf0879fc23a P 3746194b135640ee8c45ff71e8b36bcc: Deleting consensus metadata
I20260805 22:40:01.684664 1386 catalog_manager.cc:4841] TS 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041): tablet 8889301e145f4c7e9277bdf0879fc23a (table test-table [id=39ef9b613c864a12af1c02656213293c]) successfully deleted
I20260805 22:40:01.684804 1385 catalog_manager.cc:4841] TS 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899): tablet 8889301e145f4c7e9277bdf0879fc23a (table test-table [id=39ef9b613c864a12af1c02656213293c]) successfully deleted
W20260805 22:40:01.686378 1387 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:34435 (error 108)
I20260805 22:40:01.686686 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 1601
I20260805 22:40:01.687829 1881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:01.686857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:34435 (local address 127.0.0.1:50562)
0805 22:40:01.687750 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:01.687795 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:34435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":867}
W20260805 22:40:01.688025 1387 catalog_manager.cc:4584] TS 639af51b483348a2878b35e1b1996667 (127.19.77.129:34435): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8889301e145f4c7e9277bdf0879fc23a: Network error: Client connection negotiation failed: client connection to 127.19.77.129:34435: connect: Connection refused (error 111)
I20260805 22:40:01.694480 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 1738
I20260805 22:40:01.700631 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 1367
I20260805 22:40:01.707706 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:41221
--webserver_interface=127.19.77.190
--webserver_port=43343
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:41221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:01.797699 1914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:01.797941 1914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:01.797967 1914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:01.799279 1914 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:40:01.799331 1914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:01.799346 1914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:01.799360 1914 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:40:01.799372 1914 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:40:01.800971 1914 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:41221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:41221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=43343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:01.801273 1914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:01.801534 1914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:01.811865 1920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:01.811956 1923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:01.812011 1921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:01.812201 1914 server_base.cc:1034] running on GCE node
I20260805 22:40:01.812570 1914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:01.812927 1914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:01.814126 1914 hybrid_clock.cc:648] HybridClock initialized: now 1785969601814116 us; error 44 us; skew 500 ppm
Aug 05 22:40:01 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:01.816951 1914 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:40:01.817480 1914 webserver.cc:460] Webserver started at http://127.19.77.190:43343/ using document root <none> and password file <none>
I20260805 22:40:01.817744 1914 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:01.817840 1914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:01.819487 1914 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:40:01.820426 1931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.820632 1914 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:01.820814 1914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "41ffc861886c4f3a9237dabb0f2060b7"
format_stamp: "Formatted at 2026-08-05 22:40:00 on dist-test-slave-chsk"
server_key: "12a0bb9e9bdb0958ddff37575a2bba27"
server_key_iv: "691c3e7240d827281bfc3ad9ef646cdb"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.821321 1914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:01.838660 1914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:01.841471 1914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:01.841674 1914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:01.846526 1914 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:41221
I20260805 22:40:01.846575 1983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:41221 every 8 connection(s)
I20260805 22:40:01.847050 1914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:40:01.848915 1984 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:40:01.849670 1984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Bootstrap starting.
I20260805 22:40:01.854311 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 1914
I20260805 22:40:01.854707 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:34435
--local_ip_for_outbound_sockets=127.19.77.129
--tserver_master_addrs=127.19.77.190:41221
--webserver_port=45141
--webserver_interface=127.19.77.129
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:40:01.860646 1984 log.cc:824] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:01.862785 1984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:40:01.863202 1984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Bootstrap complete.
I20260805 22:40:01.865721 1984 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:01.865994 1984 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41ffc861886c4f3a9237dabb0f2060b7, State: Initialized, Role: FOLLOWER
I20260805 22:40:01.866214 1984 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:01.866317 1984 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:40:01.866380 1984 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:40:01.866430 1984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:40:01.867609 1984 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:01.867736 1984 leader_election.cc:302] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41ffc861886c4f3a9237dabb0f2060b7; no voters:
I20260805 22:40:01.867937 1984 leader_election.cc:288] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:40:01.868026 1988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:40:01.868234 1984 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:40:01.868261 1988 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 2 LEADER]: Becoming Leader. State: Replica: 41ffc861886c4f3a9237dabb0f2060b7, State: Running, Role: LEADER
I20260805 22:40:01.868513 1988 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:01.868839 1989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "41ffc861886c4f3a9237dabb0f2060b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } } }
I20260805 22:40:01.868907 1989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:40:01.869194 1990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41ffc861886c4f3a9237dabb0f2060b7. Latest consensus state: current_term: 2 leader_uuid: "41ffc861886c4f3a9237dabb0f2060b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } } }
I20260805 22:40:01.869246 1990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:40:01.869460 1995 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:40:01.870303 1995 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:40:01.870549 1995 catalog_manager.cc:1259] Loaded cluster ID: 48aab26df6d6418abbc7adce47950bcd
I20260805 22:40:01.870690 1995 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:40:01.870978 1995 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260805 22:40:01.875661 1995 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260805 22:40:01.878415 1995 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:40:01.878674 1995 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Loaded TSK: 0
I20260805 22:40:01.878906 1995 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:40:01.945765 1986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:01.946015 1986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:01.946045 1986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:01.948009 1986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:01.948071 1986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:01.948104 1986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:40:01.949867 1986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:34435
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=45141
--tserver_master_addrs=127.19.77.190:41221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:01.950189 1986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:01.950464 1986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:01.955997 2013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:01.955997 2012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:01.956276 1986 server_base.cc:1034] running on GCE node
W20260805 22:40:01.956027 2016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:01.956571 1986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:01.956880 1986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:01.958087 1986 hybrid_clock.cc:648] HybridClock initialized: now 1785969601958074 us; error 31 us; skew 500 ppm
Aug 05 22:40:01 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:01.961035 1986 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:40:01.961628 1986 webserver.cc:460] Webserver started at http://127.19.77.129:45141/ using document root <none> and password file <none>
I20260805 22:40:01.961894 1986 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:01.961997 1986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:01.963508 1986 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:40:01.964260 2023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:01.964527 1986 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:40:01.964648 1986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "639af51b483348a2878b35e1b1996667"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "27448744687b195fe9f53fa1e73e7de5"
server_key_iv: "3caa43c6febf122d4f95270e77af9966"
server_key_version: "encryptionkey@0"
I20260805 22:40:01.965140 1986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:02.003626 1986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:02.006568 1986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:02.006736 1986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:02.007017 1986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:02.007593 2030 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260805 22:40:02.009284 1986 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 22:40:02.009356 1986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260805 22:40:02.009392 1986 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260805 22:40:02.010341 1986 ts_tablet_manager.cc:610] Registered 1 tablets
I20260805 22:40:02.010413 1986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260805 22:40:02.010473 2030 tablet_bootstrap.cc:492] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Bootstrap starting.
I20260805 22:40:02.018091 1986 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:34435
I20260805 22:40:02.018381 2137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:34435 every 8 connection(s)
I20260805 22:40:02.018574 1986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:40:02.022992 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 1986
I20260805 22:40:02.023383 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:38899
--local_ip_for_outbound_sockets=127.19.77.130
--tserver_master_addrs=127.19.77.190:41221
--webserver_port=45501
--webserver_interface=127.19.77.130
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:40:02.023692 2030 log.cc:824] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:02.026574 2030 tablet_bootstrap.cc:492] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:40:02.026957 2030 tablet_bootstrap.cc:492] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Bootstrap complete.
I20260805 22:40:02.028240 2030 ts_tablet_manager.cc:1397] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.014s
Aug 05 22:40:02 dist-test-slave-chsk krb5kdc[1354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:02.029582 2030 raft_consensus.cc:348] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:02.029917 2030 raft_consensus.cc:729] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 639af51b483348a2878b35e1b1996667, State: Initialized, Role: FOLLOWER
I20260805 22:40:02.030094 2030 consensus_queue.cc:260] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } }
I20260805 22:40:02.030413 2030 ts_tablet_manager.cc:1428] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260805 22:40:02.033674 2141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.019515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:40211 (local address 127.19.77.190:41221)
0805 22:40:02.019746 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.019756 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.019994 (+ 238us) server_negotiation.cc:407] Connection header received
0805 22:40:02.021014 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.021021 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.021082 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.021320 (+ 238us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:02.022555 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.023957 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.025724 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.026356 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.026478 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.029758 (+ 3280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:02.029762 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:02.029763 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:02.029778 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:02.031702 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:02.032265 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:02.032268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:02.032269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:02.032363 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:02.032688 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:02.032689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:02.032689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:02.032908 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:02.032973 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.033389 (+ 416us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.033519 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":130,"threads_started":1}
I20260805 22:40:02.034224 2140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.019388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:40211)
0805 22:40:02.019803 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.019857 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:02.020773 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:02.021388 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:02.021395 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:02.022001 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:02.022401 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.022410 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.024114 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.024116 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.025621 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.025625 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.026489 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.026490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.026605 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.027418 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:02.027428 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:02.029615 (+ 2187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:02.031796 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:02.031806 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:02.031808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:02.032172 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:02.032440 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:02.032441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:02.032441 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:02.032612 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:02.032987 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:02.032995 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:02.033185 (+ 190us) client_negotiation.cc:769] Sending connection context
0805 22:40:02.033336 (+ 151us) client_negotiation.cc:240] Negotiation successful
0805 22:40:02.033576 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":95,"threads_started":1}
I20260805 22:40:02.035061 2138 heartbeater.cc:347] Connected to a master server at 127.19.77.190:41221
I20260805 22:40:02.035212 2138 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:02.035434 2138 heartbeater.cc:511] Master 127.19.77.190:41221 requested a full tablet report, sending...
I20260805 22:40:02.036298 1948 ts_manager.cc:194] Registered new tserver with Master: 639af51b483348a2878b35e1b1996667 (127.19.77.129:34435)
I20260805 22:40:02.037701 1948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:40211
I20260805 22:40:02.038703 2138 heartbeater.cc:503] Master 127.19.77.190:41221 was elected leader, sending a full tablet report...
Aug 05 22:40:02 dist-test-slave-chsk krb5kdc[1354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:40:02.047504 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.037064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:34435 (local address 127.0.0.1:50576)
0805 22:40:02.037370 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.037398 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:02.037498 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:02.037733 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:02.037739 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:02.038185 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:02.038252 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.038255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.039830 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.039833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.040873 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.040878 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.041698 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.041700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.041807 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.042437 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:02.042442 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:02.044000 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:02.046206 (+ 2206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:02.046217 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:02.046219 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:02.046451 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:02.046689 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:02.046690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:02.046690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:02.046746 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:02.047107 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:02.047114 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:02.047232 (+ 118us) client_negotiation.cc:769] Sending connection context
0805 22:40:02.047304 (+ 72us) client_negotiation.cc:240] Negotiation successful
0805 22:40:02.047427 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":121,"threads_started":1}
I20260805 22:40:02.047590 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.037111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50576 (local address 127.19.77.129:34435)
0805 22:40:02.037300 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.037313 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.037475 (+ 162us) server_negotiation.cc:407] Connection header received
0805 22:40:02.037612 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.037615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.037641 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.037714 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:02.038346 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.039634 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.041025 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.041557 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.041655 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.044112 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:02.044128 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:02.044128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:02.044138 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:02.046099 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:02.046543 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:02.046547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:02.046547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:02.046619 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:02.046814 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:02.046814 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:02.046815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:02.047039 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:02.047127 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.047368 (+ 241us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.047482 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":157,"thread_start_us":79,"threads_started":1}
I20260805 22:40:02.048414 2072 tablet_service.cc:1514] Processing DeleteTablet for tablet 8889301e145f4c7e9277bdf0879fc23a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:01 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:50576
I20260805 22:40:02.049022 2147 tablet_replica.cc:330] stopping tablet replica
I20260805 22:40:02.049147 2147 raft_consensus.cc:2229] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:40:02.049247 2147 raft_consensus.cc:2258] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:02.049615 2147 ts_tablet_manager.cc:1905] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:02.051896 2147 ts_tablet_manager.cc:1918] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:40:02.051975 2147 log.cc:1196] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/8889301e145f4c7e9277bdf0879fc23a
I20260805 22:40:02.052217 2147 ts_tablet_manager.cc:1939] T 8889301e145f4c7e9277bdf0879fc23a P 639af51b483348a2878b35e1b1996667: Deleting consensus metadata
I20260805 22:40:02.052804 1935 catalog_manager.cc:4841] TS 639af51b483348a2878b35e1b1996667 (127.19.77.129:34435): tablet 8889301e145f4c7e9277bdf0879fc23a (table test-table [id=39ef9b613c864a12af1c02656213293c]) successfully deleted
W20260805 22:40:02.117763 2143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:02.118055 2143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:02.118099 2143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:02.119412 2143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:02.119498 2143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:02.119545 2143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:40:02.121251 2143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:38899
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=45501
--tserver_master_addrs=127.19.77.190:41221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:02.121559 2143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:02.121819 2143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:02.127668 2152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:02.127663 2153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:02.127673 2155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:02.127942 2143 server_base.cc:1034] running on GCE node
I20260805 22:40:02.128249 2143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:02.128481 2143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:02.129637 2143 hybrid_clock.cc:648] HybridClock initialized: now 1785969602129631 us; error 37 us; skew 500 ppm
Aug 05 22:40:02 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:02.132477 2143 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:40:02.133024 2143 webserver.cc:460] Webserver started at http://127.19.77.130:45501/ using document root <none> and password file <none>
I20260805 22:40:02.133279 2143 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:02.133363 2143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:02.134897 2143 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:40:02.135954 2164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.136165 2143 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:02.136291 2143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "3746194b135640ee8c45ff71e8b36bcc"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "ed95543e8fc75be5b46b04d256ca3e90"
server_key_iv: "c8a8be1c37c1ec1ebec95abce6694c4d"
server_key_version: "encryptionkey@0"
I20260805 22:40:02.136700 2143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:02.149483 2143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:02.151985 2143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:02.152213 2143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:02.152510 2143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:02.152796 2143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:02.152829 2143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.152851 2143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:02.152864 2143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.161202 2143 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:38899
I20260805 22:40:02.161273 2277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:38899 every 8 connection(s)
I20260805 22:40:02.161680 2143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
Aug 05 22:40:02 dist-test-slave-chsk krb5kdc[1354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:02.171474 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 2143
I20260805 22:40:02.171834 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:43041
--local_ip_for_outbound_sockets=127.19.77.131
--tserver_master_addrs=127.19.77.190:41221
--webserver_port=43349
--webserver_interface=127.19.77.131
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:40:02.173334 2141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.162499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:59305 (local address 127.19.77.190:41221)
0805 22:40:02.162581 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.162583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.162839 (+ 256us) server_negotiation.cc:407] Connection header received
0805 22:40:02.163588 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.163590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.163608 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.163666 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:02.164680 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.165204 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.166339 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.166574 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.166668 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.169414 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:02.169415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:02.169416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:02.169425 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:02.171185 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:02.171809 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:02.171811 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:02.171811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:02.171878 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:02.172231 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:02.172232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:02.172232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:02.172370 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:02.172451 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.172996 (+ 545us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.173185 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260805 22:40:02.173697 2280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.162486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:59305)
0805 22:40:02.162709 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.162747 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:02.163401 (+ 654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:02.163743 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:02.163746 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:02.164363 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:02.164574 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.164579 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.165313 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.165314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.166235 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.166238 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.166684 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.166685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.166817 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.167456 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:02.167465 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:02.169314 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:02.171309 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:02.171322 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:02.171325 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:02.171720 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:02.172007 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:02.172009 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:02.172009 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:02.172156 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:02.172463 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:02.172471 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:02.172618 (+ 147us) client_negotiation.cc:769] Sending connection context
0805 22:40:02.172960 (+ 342us) client_negotiation.cc:240] Negotiation successful
0805 22:40:02.173268 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":127,"threads_started":1}
I20260805 22:40:02.174424 2278 heartbeater.cc:347] Connected to a master server at 127.19.77.190:41221
I20260805 22:40:02.174580 2278 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:02.174794 2278 heartbeater.cc:511] Master 127.19.77.190:41221 requested a full tablet report, sending...
I20260805 22:40:02.175321 1948 ts_manager.cc:194] Registered new tserver with Master: 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899)
I20260805 22:40:02.175886 1948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:59305
W20260805 22:40:02.261619 2281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:02.261853 2281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:02.261880 2281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:02.263043 2281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:02.263085 2281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:02.263113 2281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:40:02.264725 2281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:43041
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=43349
--tserver_master_addrs=127.19.77.190:41221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:02.264946 2281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:02.265151 2281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:02.270953 2286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:02.270946 2287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:02.270948 2289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:02.271692 2281 server_base.cc:1034] running on GCE node
I20260805 22:40:02.271963 2281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:02.272322 2281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:02.273537 2281 hybrid_clock.cc:648] HybridClock initialized: now 1785969602273519 us; error 31 us; skew 500 ppm
Aug 05 22:40:02 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:02.276407 2281 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:40:02.276955 2281 webserver.cc:460] Webserver started at http://127.19.77.131:43349/ using document root <none> and password file <none>
I20260805 22:40:02.277180 2281 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:02.277256 2281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:02.278630 2281 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:02.279345 2297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.279569 2281 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:40:02.279690 2281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "11cce5d94c824aad8dc6974f6e29dd2d"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "5c3d8eaae8d52acd5e006e744c219b9c"
server_key_iv: "c596d48a64fec89958a9e9b94d35d3be"
server_key_version: "encryptionkey@0"
I20260805 22:40:02.280081 2281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:02.297456 2281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:02.300279 2281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:02.300423 2281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:02.300701 2281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:02.301061 2281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:02.301097 2281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.301155 2281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:02.301184 2281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.307636 2281 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:43041
I20260805 22:40:02.307667 2414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:43041 every 8 connection(s)
I20260805 22:40:02.308104 2281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:40:02.309203 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 2281
Aug 05 22:40:02 dist-test-slave-chsk krb5kdc[1354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:02.317761 2419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.309664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47556 (local address 127.19.77.190:41221)
0805 22:40:02.309781 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.309783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.309891 (+ 108us) server_negotiation.cc:407] Connection header received
0805 22:40:02.309950 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.309951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.309965 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.310037 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:02.310714 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.311516 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.312599 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.312897 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.312977 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.314639 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:02.314641 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:02.314642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:02.314650 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:02.316363 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:02.316832 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:02.316833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:02.316834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:02.316947 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:02.317135 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:02.317136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:02.317137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:02.317288 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:02.317465 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.317530 (+ 65us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.317626 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":65,"threads_started":1}
I20260805 22:40:02.320080 2141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.309051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:45905 (local address 127.19.77.190:41221)
0805 22:40:02.309135 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.309137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.309419 (+ 282us) server_negotiation.cc:407] Connection header received
0805 22:40:02.310165 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.310166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.310178 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.310222 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:02.311465 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.312225 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.313742 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.314030 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.314119 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.316836 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:02.316837 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:02.316838 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:02.316845 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:02.318618 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:02.319102 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:02.319103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:02.319103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:02.319204 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:02.319448 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:02.319449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:02.319449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:02.319562 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:02.319618 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.319926 (+ 308us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.320006 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260805 22:40:02.320251 2417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.309030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:45905)
0805 22:40:02.309255 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.309318 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:02.310059 (+ 741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:02.310307 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:02.310310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:02.311057 (+ 747us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:02.311377 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.311384 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.312349 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.312350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.313533 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.313537 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.314150 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.314151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.314288 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.314847 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:02.314857 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:02.316722 (+ 1865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:02.318702 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:02.318712 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:02.318715 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:02.319025 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:02.319270 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:02.319271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:02.319271 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:02.319378 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:02.319628 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:02.319633 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:02.319763 (+ 130us) client_negotiation.cc:769] Sending connection context
0805 22:40:02.319864 (+ 101us) client_negotiation.cc:240] Negotiation successful
0805 22:40:02.320029 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":111,"threads_started":1}
I20260805 22:40:02.320775 2415 heartbeater.cc:347] Connected to a master server at 127.19.77.190:41221
I20260805 22:40:02.320887 2415 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:02.321112 2415 heartbeater.cc:511] Master 127.19.77.190:41221 requested a full tablet report, sending...
I20260805 22:40:02.321571 1948 ts_manager.cc:194] Registered new tserver with Master: 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041)
I20260805 22:40:02.321990 1948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:45905
I20260805 22:40:02.330018 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:40:02.333088 2141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.330470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47572 (local address 127.19.77.190:41221)
0805 22:40:02.330558 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.330561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.330667 (+ 106us) server_negotiation.cc:407] Connection header received
0805 22:40:02.330724 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.330725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.330764 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.330842 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:40:02.330953 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.331520 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.332302 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.332503 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.332565 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.332723 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:40:02.332840 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:40:02.332911 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.332943 (+ 32us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.332965 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260805 22:40:02.333448 1948 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:47572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:40:02.335130 1948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:40:02.337728 2072 tablet_service.cc:1467] Processing CreateTablet for tablet 68060330ef1740aab9a13f4dd1dfc5d4 (DEFAULT_TABLE table=test-table [id=03c3d42eef354057aa8469596c590b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:02.337991 2072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68060330ef1740aab9a13f4dd1dfc5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:02.339781 2030 tablet_bootstrap.cc:492] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Bootstrap starting.
I20260805 22:40:02.340175 2030 tablet_bootstrap.cc:654] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:02.340845 2030 tablet_bootstrap.cc:492] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: No bootstrap required, opened a new log
I20260805 22:40:02.340893 2030 ts_tablet_manager.cc:1397] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260805 22:40:02.341292 2030 raft_consensus.cc:348] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.341398 2030 raft_consensus.cc:374] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:02.341466 2030 raft_consensus.cc:729] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 639af51b483348a2878b35e1b1996667, State: Initialized, Role: FOLLOWER
I20260805 22:40:02.341529 2030 consensus_queue.cc:260] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.341638 2030 ts_tablet_manager.cc:1428] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260805 22:40:02.342252 2421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.337474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:38899 (local address 127.0.0.1:59762)
0805 22:40:02.337594 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.337606 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:02.337662 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:02.338174 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:02.338175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:02.338178 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:02.338264 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.338266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.339830 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.339831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.340809 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.340812 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.341959 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.341960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.342026 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.342059 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 22:40:02.342117 (+ 58us) client_negotiation.cc:240] Negotiation successful
0805 22:40:02.342165 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":7,"thread_start_us":71,"threads_started":1}
I20260805 22:40:02.342299 2423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.337718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59762 (local address 127.19.77.130:38899)
0805 22:40:02.337957 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.337962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.337973 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:40:02.338020 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.338022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.338040 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.338351 (+ 311us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:02.338435 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.339694 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.341015 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.341840 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.341959 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.342033 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.342150 (+ 117us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.342203 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":115,"threads_started":1}
I20260805 22:40:02.342898 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.337443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:43041 (local address 127.0.0.1:56514)
0805 22:40:02.337493 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.337520 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:02.337559 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:02.338221 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:02.338223 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:02.338224 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:02.338274 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.338277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.339628 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.339629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.340897 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.340900 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.342670 (+ 1770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.342671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.342748 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.342753 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:40:02.342784 (+ 31us) client_negotiation.cc:240] Negotiation successful
0805 22:40:02.342833 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260805 22:40:02.343267 2422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.337709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56514 (local address 127.19.77.131:43041)
0805 22:40:02.338023 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.338026 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.338037 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:40:02.338073 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.338075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.338107 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.338220 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:02.338335 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.339519 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.341740 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.342574 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.343012 (+ 438us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.343079 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.343107 (+ 28us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.343179 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":143,"threads_started":1}
I20260805 22:40:02.343254 2212 tablet_service.cc:1467] Processing CreateTablet for tablet 68060330ef1740aab9a13f4dd1dfc5d4 (DEFAULT_TABLE table=test-table [id=03c3d42eef354057aa8469596c590b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:02.343667 2212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68060330ef1740aab9a13f4dd1dfc5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:02.343940 2348 tablet_service.cc:1467] Processing CreateTablet for tablet 68060330ef1740aab9a13f4dd1dfc5d4 (DEFAULT_TABLE table=test-table [id=03c3d42eef354057aa8469596c590b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:02.344249 2348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68060330ef1740aab9a13f4dd1dfc5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:02.346747 2425 tablet_bootstrap.cc:492] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: Bootstrap starting.
I20260805 22:40:02.347004 2426 tablet_bootstrap.cc:492] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: Bootstrap starting.
I20260805 22:40:02.347539 2425 tablet_bootstrap.cc:654] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:02.347675 2426 tablet_bootstrap.cc:654] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:02.348193 2425 log.cc:824] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:02.348270 2426 log.cc:824] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:02.349130 2425 tablet_bootstrap.cc:492] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: No bootstrap required, opened a new log
I20260805 22:40:02.349144 2426 tablet_bootstrap.cc:492] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: No bootstrap required, opened a new log
I20260805 22:40:02.349212 2425 ts_tablet_manager.cc:1397] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:40:02.349212 2426 ts_tablet_manager.cc:1397] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:40:02.351279 2426 raft_consensus.cc:348] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.351279 2425 raft_consensus.cc:348] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.351462 2425 raft_consensus.cc:374] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:02.351462 2426 raft_consensus.cc:374] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:02.351501 2425 raft_consensus.cc:729] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3746194b135640ee8c45ff71e8b36bcc, State: Initialized, Role: FOLLOWER
I20260805 22:40:02.351501 2426 raft_consensus.cc:729] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11cce5d94c824aad8dc6974f6e29dd2d, State: Initialized, Role: FOLLOWER
I20260805 22:40:02.351647 2425 consensus_queue.cc:260] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.351686 2426 consensus_queue.cc:260] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.351961 2425 ts_tablet_manager.cc:1428] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:40:02.351961 2426 ts_tablet_manager.cc:1428] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:40:02.352104 2415 heartbeater.cc:503] Master 127.19.77.190:41221 was elected leader, sending a full tablet report...
I20260805 22:40:02.352401 2278 heartbeater.cc:503] Master 127.19.77.190:41221 was elected leader, sending a full tablet report...
I20260805 22:40:02.411191 2144 raft_consensus.cc:482] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:40:02.411432 2144 raft_consensus.cc:504] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.411883 2144 leader_election.cc:288] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041), 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899)
W20260805 22:40:02.412356 2279 tablet.cc:2369] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:40:02.416196 2422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.412126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:47947 (local address 127.19.77.131:43041)
0805 22:40:02.412177 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.412179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.412191 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:40:02.412311 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.412312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.412324 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.412372 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:02.412593 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.413375 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.415121 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.415744 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.415839 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.415849 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.416073 (+ 224us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.416123 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:40:02.416196 2423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.412159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:35575 (local address 127.19.77.130:38899)
0805 22:40:02.412203 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.412206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.412374 (+ 168us) server_negotiation.cc:407] Connection header received
0805 22:40:02.412483 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.412484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.412494 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.412524 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:02.412784 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.413466 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.415108 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.415744 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.415840 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.415849 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.416077 (+ 228us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.416116 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:40:02.416229 2140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.412075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:43041 (local address 127.19.77.129:47947)
0805 22:40:02.412135 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.412147 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:02.412206 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:02.412427 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:02.412428 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:02.412431 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:02.412518 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.412520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.413476 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.413477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.414972 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.414976 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.415859 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.415860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.415943 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.415982 (+ 39us) client_negotiation.cc:769] Sending connection context
0805 22:40:02.416050 (+ 68us) client_negotiation.cc:240] Negotiation successful
0805 22:40:02.416103 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":85}
I20260805 22:40:02.416249 2431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.412106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:38899 (local address 127.19.77.129:35575)
0805 22:40:02.412308 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.412318 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:02.412404 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:02.412593 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:02.412594 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:02.412596 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:02.412701 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.412703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.413544 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.413545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.414972 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:02.414976 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.415876 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.415877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:02.415943 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.415983 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:40:02.416072 (+ 89us) client_negotiation.cc:240] Negotiation successful
0805 22:40:02.416103 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":95,"thread_start_us":130,"threads_started":1}
I20260805 22:40:02.416697 2368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68060330ef1740aab9a13f4dd1dfc5d4" candidate_uuid: "639af51b483348a2878b35e1b1996667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" is_pre_election: true
I20260805 22:40:02.416728 2232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68060330ef1740aab9a13f4dd1dfc5d4" candidate_uuid: "639af51b483348a2878b35e1b1996667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3746194b135640ee8c45ff71e8b36bcc" is_pre_election: true
I20260805 22:40:02.416920 2232 raft_consensus.cc:2454] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 639af51b483348a2878b35e1b1996667 in term 0.
I20260805 22:40:02.416909 2368 raft_consensus.cc:2454] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 639af51b483348a2878b35e1b1996667 in term 0.
I20260805 22:40:02.417193 2026 leader_election.cc:302] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11cce5d94c824aad8dc6974f6e29dd2d, 639af51b483348a2878b35e1b1996667; no voters:
I20260805 22:40:02.417351 2144 raft_consensus.cc:2781] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:40:02.417414 2144 raft_consensus.cc:482] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:40:02.417472 2144 raft_consensus.cc:3037] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:02.418331 2144 raft_consensus.cc:504] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.418514 2144 leader_election.cc:288] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 1 election: Requested vote from peers 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041), 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899)
I20260805 22:40:02.418722 2368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68060330ef1740aab9a13f4dd1dfc5d4" candidate_uuid: "639af51b483348a2878b35e1b1996667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11cce5d94c824aad8dc6974f6e29dd2d"
I20260805 22:40:02.418768 2232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68060330ef1740aab9a13f4dd1dfc5d4" candidate_uuid: "639af51b483348a2878b35e1b1996667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3746194b135640ee8c45ff71e8b36bcc"
I20260805 22:40:02.418828 2368 raft_consensus.cc:3037] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:02.418867 2232 raft_consensus.cc:3037] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:02.419732 2232 raft_consensus.cc:2454] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 639af51b483348a2878b35e1b1996667 in term 1.
I20260805 22:40:02.419749 2368 raft_consensus.cc:2454] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 639af51b483348a2878b35e1b1996667 in term 1.
I20260805 22:40:02.419943 2025 leader_election.cc:302] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3746194b135640ee8c45ff71e8b36bcc, 639af51b483348a2878b35e1b1996667; no voters:
I20260805 22:40:02.420068 2144 raft_consensus.cc:2781] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:40:02.420231 2144 raft_consensus.cc:686] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 LEADER]: Becoming Leader. State: Replica: 639af51b483348a2878b35e1b1996667, State: Running, Role: LEADER
I20260805 22:40:02.420289 2144 consensus_queue.cc:237] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.421147 1948 catalog_manager.cc:5495] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 reported cstate change: term changed from 0 to 1, leader changed from <none> to 639af51b483348a2878b35e1b1996667 (127.19.77.129). New cstate: current_term: 1 leader_uuid: "639af51b483348a2878b35e1b1996667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } health_report { overall_health: HEALTHY } } }
I20260805 22:40:02.436758 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.433261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50578 (local address 127.19.77.129:34435)
0805 22:40:02.433394 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:02.433397 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:02.433506 (+ 109us) server_negotiation.cc:407] Connection header received
0805 22:40:02.433659 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:02.433661 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:02.433700 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:02.433807 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:40:02.433975 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.434856 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.435826 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:02.436071 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:02.436173 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:02.436371 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:40:02.436490 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:40:02.436580 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:02.436628 (+ 48us) server_negotiation.cc:299] Negotiation successful
0805 22:40:02.436662 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 22:40:02.438557 2368 raft_consensus.cc:1261] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d [term 1 FOLLOWER]: Refusing update from remote peer 639af51b483348a2878b35e1b1996667: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:40:02.438571 2232 raft_consensus.cc:1261] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc [term 1 FOLLOWER]: Refusing update from remote peer 639af51b483348a2878b35e1b1996667: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:40:02.438939 2432 consensus_queue.cc:1035] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:40:02.439095 2144 consensus_queue.cc:1035] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:40:02.442276 2434 mvcc.cc:205] Tried to move back new op lower bound from 7315331491585527808 to 7315331491514236928. Current Snapshot: MvccSnapshot[applied={T|T < 7315331491585527808}]
I20260805 22:40:02.445181 1948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:47572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:40:02.445315 1948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:47572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:40:02.446204 1948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Sending DeleteTablet for 3 replicas of tablet 68060330ef1740aab9a13f4dd1dfc5d4
I20260805 22:40:02.446552 2072 tablet_service.cc:1514] Processing DeleteTablet for tablet 68060330ef1740aab9a13f4dd1dfc5d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:02 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:50576
I20260805 22:40:02.446658 2147 tablet_replica.cc:330] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: stopping tablet replica
I20260805 22:40:02.446609 2348 tablet_service.cc:1514] Processing DeleteTablet for tablet 68060330ef1740aab9a13f4dd1dfc5d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:02 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:56514
I20260805 22:40:02.446622 2212 tablet_service.cc:1514] Processing DeleteTablet for tablet 68060330ef1740aab9a13f4dd1dfc5d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:02 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:59762
I20260805 22:40:02.446704 2147 raft_consensus.cc:2229] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:40:02.446817 2147 raft_consensus.cc:2258] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:02.447022 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 1986
I20260805 22:40:02.447239 2147 ts_tablet_manager.cc:1905] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:02.448297 2445 tablet_replica.cc:330] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: stopping tablet replica
I20260805 22:40:02.448468 2445 raft_consensus.cc:2229] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:40:02.448599 2445 raft_consensus.cc:2258] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:02.448783 2444 tablet_replica.cc:330] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: stopping tablet replica
I20260805 22:40:02.448902 2444 raft_consensus.cc:2229] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:40:02.449007 2444 raft_consensus.cc:2258] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:02.449131 2445 ts_tablet_manager.cc:1905] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:02.449450 2444 ts_tablet_manager.cc:1905] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:02.450894 2445 ts_tablet_manager.cc:1918] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:40:02.451016 2445 log.cc:1196] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/68060330ef1740aab9a13f4dd1dfc5d4
I20260805 22:40:02.451089 2444 ts_tablet_manager.cc:1918] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:40:02.451210 2444 log.cc:1196] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/68060330ef1740aab9a13f4dd1dfc5d4
I20260805 22:40:02.451385 2445 ts_tablet_manager.cc:1939] T 68060330ef1740aab9a13f4dd1dfc5d4 P 3746194b135640ee8c45ff71e8b36bcc: Deleting consensus metadata
I20260805 22:40:02.451510 2444 ts_tablet_manager.cc:1939] T 68060330ef1740aab9a13f4dd1dfc5d4 P 11cce5d94c824aad8dc6974f6e29dd2d: Deleting consensus metadata
I20260805 22:40:02.451982 1933 catalog_manager.cc:4841] TS 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899): tablet 68060330ef1740aab9a13f4dd1dfc5d4 (table test-table [id=03c3d42eef354057aa8469596c590b3d]) successfully deleted
W20260805 22:40:02.455257 1935 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:34435 (error 108)
I20260805 22:40:02.455395 1934 catalog_manager.cc:4841] TS 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041): tablet 68060330ef1740aab9a13f4dd1dfc5d4 (table test-table [id=03c3d42eef354057aa8469596c590b3d]) successfully deleted
I20260805 22:40:02.455868 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.455719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:34435 (local address 127.0.0.1:50580)
0805 22:40:02.455779 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.455822 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:34435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260805 22:40:02.456002 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 2143
W20260805 22:40:02.456019 1935 catalog_manager.cc:4584] TS 639af51b483348a2878b35e1b1996667 (127.19.77.129:34435): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 68060330ef1740aab9a13f4dd1dfc5d4: Network error: Client connection negotiation failed: client connection to 127.19.77.129:34435: connect: Connection refused (error 111)
I20260805 22:40:02.463925 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 2281
I20260805 22:40:02.470947 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 1914
I20260805 22:40:02.478123 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:41221
--webserver_interface=127.19.77.190
--webserver_port=43343
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:41221
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:02.564662 2447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:02.564955 2447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:02.564999 2447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:02.566366 2447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:40:02.566452 2447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:02.566478 2447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:02.566500 2447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:40:02.566535 2447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:40:02.568293 2447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:41221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:41221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=43343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:02.568636 2447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:02.568912 2447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:02.574267 2455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:02.574249 2452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:02.574249 2453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:02.574436 2447 server_base.cc:1034] running on GCE node
I20260805 22:40:02.574780 2447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:02.575106 2447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:02.576355 2447 hybrid_clock.cc:648] HybridClock initialized: now 1785969602576334 us; error 41 us; skew 500 ppm
Aug 05 22:40:02 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:02.579270 2447 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:40:02.579782 2447 webserver.cc:460] Webserver started at http://127.19.77.190:43343/ using document root <none> and password file <none>
I20260805 22:40:02.580066 2447 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:02.580148 2447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:02.581701 2447 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260805 22:40:02.582512 2462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.582715 2447 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:02.582839 2447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "41ffc861886c4f3a9237dabb0f2060b7"
format_stamp: "Formatted at 2026-08-05 22:40:00 on dist-test-slave-chsk"
server_key: "12a0bb9e9bdb0958ddff37575a2bba27"
server_key_iv: "691c3e7240d827281bfc3ad9ef646cdb"
server_key_version: "encryptionkey@0"
I20260805 22:40:02.583289 2447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:02.598188 2447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:02.600663 2447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:02.600872 2447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:02.605348 2447 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:41221
I20260805 22:40:02.605399 2516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:41221 every 8 connection(s)
I20260805 22:40:02.605830 2447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:40:02.607678 2517 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:40:02.608428 2517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Bootstrap starting.
I20260805 22:40:02.614799 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 2447
I20260805 22:40:02.615264 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:34435
--local_ip_for_outbound_sockets=127.19.77.129
--tserver_master_addrs=127.19.77.190:41221
--webserver_port=45141
--webserver_interface=127.19.77.129
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:40:02.620711 2517 log.cc:824] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:02.623530 2517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:40:02.623919 2517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7: Bootstrap complete.
I20260805 22:40:02.626457 2517 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:02.626713 2517 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41ffc861886c4f3a9237dabb0f2060b7, State: Initialized, Role: FOLLOWER
I20260805 22:40:02.626892 2517 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:02.626981 2517 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:40:02.627044 2517 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:40:02.627097 2517 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 2 FOLLOWER]: Advancing to term 3
I20260805 22:40:02.628413 2517 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:02.628525 2517 leader_election.cc:302] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41ffc861886c4f3a9237dabb0f2060b7; no voters:
I20260805 22:40:02.628791 2517 leader_election.cc:288] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260805 22:40:02.628836 2521 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260805 22:40:02.628963 2521 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [term 3 LEADER]: Becoming Leader. State: Replica: 41ffc861886c4f3a9237dabb0f2060b7, State: Running, Role: LEADER
I20260805 22:40:02.629060 2521 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } }
I20260805 22:40:02.629112 2517 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:40:02.629369 2522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "41ffc861886c4f3a9237dabb0f2060b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } } }
I20260805 22:40:02.629472 2522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:40:02.629772 2523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41ffc861886c4f3a9237dabb0f2060b7. Latest consensus state: current_term: 3 leader_uuid: "41ffc861886c4f3a9237dabb0f2060b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ffc861886c4f3a9237dabb0f2060b7" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 41221 } } }
I20260805 22:40:02.629882 2523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41ffc861886c4f3a9237dabb0f2060b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:40:02.630102 2526 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:40:02.630965 2526 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:40:02.631074 2526 catalog_manager.cc:1259] Loaded cluster ID: 48aab26df6d6418abbc7adce47950bcd
I20260805 22:40:02.631105 2526 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260805 22:40:02.631634 2526 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f816e1f69ad google::LogMessage::Fail() at ??:0
@ 0x7f816e1f988a google::LogMessage::SendToLog() at ??:0
@ 0x7f816e1f64de google::LogMessage::Flush() at ??:0
@ 0x7f816e1f7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f81761170f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f81761208b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f81700c40d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f81700b9954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8170f1d6db start_thread at ??:0
@ 0x7f816ccf461f clone at ??:0
W20260805 22:40:02.726222 2519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:02.726460 2519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:02.726498 2519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:02.727937 2519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:02.727998 2519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:02.728053 2519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:40:02.729836 2519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:34435
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=45141
--tserver_master_addrs=127.19.77.190:41221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:02.730135 2519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:02.730419 2519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:02.737504 2553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:02.737532 2554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:02.737782 2556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:02.737665 2519 server_base.cc:1034] running on GCE node
I20260805 22:40:02.738034 2519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:02.738345 2519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:02.739565 2519 hybrid_clock.cc:648] HybridClock initialized: now 1785969602739549 us; error 37 us; skew 500 ppm
Aug 05 22:40:02 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:02.742508 2519 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:40:02.743110 2519 webserver.cc:460] Webserver started at http://127.19.77.129:45141/ using document root <none> and password file <none>
I20260805 22:40:02.743450 2519 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:02.743508 2519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:02.745036 2519 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:40:02.745894 2564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.746129 2519 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:40:02.746239 2519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "639af51b483348a2878b35e1b1996667"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "27448744687b195fe9f53fa1e73e7de5"
server_key_iv: "3caa43c6febf122d4f95270e77af9966"
server_key_version: "encryptionkey@0"
I20260805 22:40:02.746637 2519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:02.761737 2519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:02.764446 2519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:02.764633 2519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:02.764966 2519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:02.765542 2571 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260805 22:40:02.767099 2519 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 22:40:02.767208 2519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260805 22:40:02.767247 2519 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260805 22:40:02.767966 2519 ts_tablet_manager.cc:610] Registered 1 tablets
I20260805 22:40:02.768018 2519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260805 22:40:02.768077 2571 tablet_bootstrap.cc:492] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Bootstrap starting.
I20260805 22:40:02.770288 2571 log.cc:824] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:02.774068 2571 tablet_bootstrap.cc:492] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:40:02.774471 2571 tablet_bootstrap.cc:492] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Bootstrap complete.
I20260805 22:40:02.774678 2571 ts_tablet_manager.cc:1397] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260805 22:40:02.776201 2519 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:34435
I20260805 22:40:02.776646 2519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:40:02.777278 2683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:34435 every 8 connection(s)
I20260805 22:40:02.777377 2571 raft_consensus.cc:348] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.777822 2571 raft_consensus.cc:729] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 639af51b483348a2878b35e1b1996667, State: Initialized, Role: FOLLOWER
I20260805 22:40:02.777993 2571 consensus_queue.cc:260] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:02.778297 2571 ts_tablet_manager.cc:1428] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20260805 22:40:02.785559 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 2519
I20260805 22:40:02.785908 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:38899
--local_ip_for_outbound_sockets=127.19.77.130
--tserver_master_addrs=127.19.77.190:41221
--webserver_port=45501
--webserver_interface=127.19.77.130
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:02.842348 2686 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:40:02.777439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:59771)
0805 22:40:02.777703 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.777750 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:02.778059 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:02.842103 (+ 64044us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":89,"threads_started":1}
W20260805 22:40:02.842612 2684 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:41221 (0 consecutive failures): Network error: Failed to ping master at 127.19.77.190:41221: Client connection negotiation failed: client connection to 127.19.77.190:41221: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 22:40:02.843047 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.842907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:56911)
0805 22:40:02.842952 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.843013 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260805 22:40:02.843413 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.843279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:43813)
0805 22:40:02.843329 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.843355 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260805 22:40:02.843618 2684 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:40:02.879714 2688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:02.879961 2688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:02.879992 2688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:02.881217 2688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:02.881265 2688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:02.881297 2688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:40:02.882856 2688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:38899
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=45501
--tserver_master_addrs=127.19.77.190:41221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:02.883085 2688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:02.883389 2688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:02.888865 2693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:02.888870 2696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:02.888870 2694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:02.889307 2688 server_base.cc:1034] running on GCE node
I20260805 22:40:02.889540 2688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:02.889822 2688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:02.891011 2688 hybrid_clock.cc:648] HybridClock initialized: now 1785969602891003 us; error 41 us; skew 500 ppm
Aug 05 22:40:02 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:02.893797 2688 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:40:02.894344 2688 webserver.cc:460] Webserver started at http://127.19.77.130:45501/ using document root <none> and password file <none>
I20260805 22:40:02.894632 2688 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:02.894708 2688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:02.896277 2688 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:02.896950 2703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.897150 2688 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:02.897260 2688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "3746194b135640ee8c45ff71e8b36bcc"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "ed95543e8fc75be5b46b04d256ca3e90"
server_key_iv: "c8a8be1c37c1ec1ebec95abce6694c4d"
server_key_version: "encryptionkey@0"
I20260805 22:40:02.897650 2688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:02.926463 2688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:02.929267 2688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:02.929459 2688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:02.929741 2688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:02.930075 2688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:02.930132 2688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.930178 2688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:02.930205 2688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:02.936882 2688 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:38899
I20260805 22:40:02.936964 2817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:38899 every 8 connection(s)
I20260805 22:40:02.937342 2688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:40:02.939536 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.938585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:43679)
0805 22:40:02.939000 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.939186 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":259,"threads_started":1}
W20260805 22:40:02.940163 2818 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:41221 (0 consecutive failures): Network error: Failed to ping master at 127.19.77.190:41221: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
I20260805 22:40:02.940770 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.940538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:60329)
0805 22:40:02.940654 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.940723 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260805 22:40:02.941399 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:02.941275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:55831)
0805 22:40:02.941340 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:02.941375 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260805 22:40:02.941704 2818 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:40:02.943380 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 2688
I20260805 22:40:02.943728 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:43041
--local_ip_for_outbound_sockets=127.19.77.131
--tserver_master_addrs=127.19.77.190:41221
--webserver_port=43349
--webserver_interface=127.19.77.131
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:37713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:03.031754 2821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:03.032006 2821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:03.032037 2821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:03.033305 2821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:03.033349 2821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:03.033377 2821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:40:03.035001 2821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:37713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:43041
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=43349
--tserver_master_addrs=127.19.77.190:41221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:03.035306 2821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:03.035526 2821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:03.040936 2826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:03.040936 2829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:03.041024 2827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:03.041304 2821 server_base.cc:1034] running on GCE node
I20260805 22:40:03.041545 2821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:03.041777 2821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:03.042968 2821 hybrid_clock.cc:648] HybridClock initialized: now 1785969603042942 us; error 43 us; skew 500 ppm
Aug 05 22:40:03 dist-test-slave-chsk krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969603, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:03.046275 2821 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:40:03.046938 2821 webserver.cc:460] Webserver started at http://127.19.77.131:43349/ using document root <none> and password file <none>
I20260805 22:40:03.047291 2821 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:03.047358 2821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:03.048971 2821 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:03.050042 2836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:03.050395 2821 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:03.050544 2821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "11cce5d94c824aad8dc6974f6e29dd2d"
format_stamp: "Formatted at 2026-08-05 22:40:01 on dist-test-slave-chsk"
server_key: "5c3d8eaae8d52acd5e006e744c219b9c"
server_key_iv: "c596d48a64fec89958a9e9b94d35d3be"
server_key_version: "encryptionkey@0"
I20260805 22:40:03.050956 2821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:03.068130 2821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:03.070767 2821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:03.070962 2821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:03.071303 2821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:03.071653 2821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:03.071713 2821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:03.071753 2821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:03.071781 2821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:03.077978 2821 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:43041
I20260805 22:40:03.078068 2951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:43041 every 8 connection(s)
I20260805 22:40:03.078469 2821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:40:03.080124 2955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:03.079535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:47701)
0805 22:40:03.079812 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:03.079929 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":118,"threads_started":1}
W20260805 22:40:03.080757 2952 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:41221 (0 consecutive failures): Network error: Failed to ping master at 127.19.77.190:41221: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
I20260805 22:40:03.080992 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 2821
I20260805 22:40:03.081230 2955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:03.081022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:34775)
0805 22:40:03.081119 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:03.081183 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260805 22:40:03.081696 2955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:03.081533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:54199)
0805 22:40:03.081598 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:03.081643 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260805 22:40:03.081840 2952 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:40:03.844204 2957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:03.843946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:54997)
0805 22:40:03.844085 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:03.844126 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
I20260805 22:40:03.942451 2958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:03.942179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:32811)
0805 22:40:03.942339 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:03.942385 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260805 22:40:04.082545 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:04.082265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:36269)
0805 22:40:04.082434 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:04.082481 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":66,"threads_started":1}
I20260805 22:40:04.486263 2960 raft_consensus.cc:482] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:40:04.486450 2960 raft_consensus.cc:504] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:04.486918 2960 leader_election.cc:288] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041), 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899)
Aug 05 22:40:04 dist-test-slave-chsk krb5kdc[1354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.130@KRBTEST.COM
Aug 05 22:40:04 dist-test-slave-chsk krb5kdc[1354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.131@KRBTEST.COM
I20260805 22:40:04.498212 2961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:04.487131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:38899 (local address 127.19.77.129:44037)
0805 22:40:04.487287 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:04.487300 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:04.487367 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:04.488261 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:04.488263 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:04.488713 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:04.489109 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:04.489112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:04.490216 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:04.490217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:04.490900 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:04.490902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:04.491599 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:04.491600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:04.491736 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:04.492498 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:04.492509 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:04.494212 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:04.496458 (+ 2246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:04.496467 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:04.496470 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:04.496788 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:04.497061 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:04.497061 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:04.497062 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:04.497200 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:04.497647 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:04.497648 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:04.497765 (+ 117us) client_negotiation.cc:769] Sending connection context
0805 22:40:04.497880 (+ 115us) client_negotiation.cc:240] Negotiation successful
0805 22:40:04.498088 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":54,"thread_start_us":78,"threads_started":1}
I20260805 22:40:04.498212 2963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:04.487300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:40767 (local address 127.19.77.131:43041)
0805 22:40:04.487515 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:04.487524 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:04.487554 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:40:04.488259 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:04.488262 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:04.488304 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:04.488457 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:04.489077 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:04.489952 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:04.490984 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:04.491481 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:04.491610 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:04.494756 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:04.494760 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:04.494760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:04.494772 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:04.496448 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:04.496932 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:04.496935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:04.496935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:04.497043 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:04.497308 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:04.497309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:04.497309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:04.497543 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:04.497636 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:04.497935 (+ 299us) server_negotiation.cc:299] Negotiation successful
0805 22:40:04.498077 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":66,"threads_started":1}
I20260805 22:40:04.498219 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:04.487311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:44037 (local address 127.19.77.130:38899)
0805 22:40:04.487507 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:04.487517 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:04.487536 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:40:04.487982 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:04.487984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:04.488036 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:04.488215 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:04.489244 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:04.490107 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:04.490993 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:04.491508 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:04.491634 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:04.494358 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:04.494364 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:04.494364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:04.494380 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:04.496363 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:04.496873 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:04.496876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:04.496876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:04.496989 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:04.497270 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:04.497271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:04.497271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:04.497544 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:04.497648 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:04.497939 (+ 291us) server_negotiation.cc:299] Negotiation successful
0805 22:40:04.498079 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":80,"threads_started":1}
I20260805 22:40:04.498313 2962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:04.487141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:43041 (local address 127.19.77.129:40767)
0805 22:40:04.487306 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:04.487318 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:04.487382 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:04.488455 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:04.488457 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:04.488738 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:04.488940 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:04.488947 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:04.490066 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:04.490068 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:04.490883 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:04.490886 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:04.491593 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:04.491594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:04.491734 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:04.492582 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:04.492587 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:04.494635 (+ 2048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:04.496567 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:04.496569 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:04.496569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:04.496844 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:04.497131 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:04.497132 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:04.497132 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:04.497210 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:04.497618 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:04.497627 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:04.497765 (+ 138us) client_negotiation.cc:769] Sending connection context
0805 22:40:04.497880 (+ 115us) client_negotiation.cc:240] Negotiation successful
0805 22:40:04.498177 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":142,"thread_start_us":86,"threads_started":1}
W20260805 22:40:04.499128 2566 leader_election.cc:341] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899): Not found: Tablet not found: 68060330ef1740aab9a13f4dd1dfc5d4
W20260805 22:40:04.499665 2567 leader_election.cc:341] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041): Not found: Tablet not found: 68060330ef1740aab9a13f4dd1dfc5d4
I20260805 22:40:04.499715 2567 leader_election.cc:302] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 639af51b483348a2878b35e1b1996667; no voters: 11cce5d94c824aad8dc6974f6e29dd2d, 3746194b135640ee8c45ff71e8b36bcc
I20260805 22:40:04.499827 2960 raft_consensus.cc:2726] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:40:04.844939 2962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:04.844782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:40459)
0805 22:40:04.844849 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:04.844886 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260805 22:40:04.943316 2965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:04.943010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:50979)
0805 22:40:04.943203 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:04.943261 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260805 22:40:05.083441 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:05.083186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:52769)
0805 22:40:05.083339 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:05.083390 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":66,"threads_started":1}
I20260805 22:40:05.845774 2967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:05.845486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:43919)
0805 22:40:05.845663 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:05.845723 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
I20260805 22:40:05.944118 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:05.943822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:55517)
0805 22:40:05.944015 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:05.944065 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":75,"threads_started":1}
I20260805 22:40:06.084242 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:06.084000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:55605)
0805 22:40:06.084151 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:06.084192 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":74,"threads_started":1}
I20260805 22:40:06.432188 2970 raft_consensus.cc:482] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:40:06.432353 2970 raft_consensus.cc:504] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:06.432586 2970 leader_election.cc:288] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041), 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899)
W20260805 22:40:06.433050 2567 leader_election.cc:341] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041): Not found: Tablet not found: 68060330ef1740aab9a13f4dd1dfc5d4
W20260805 22:40:06.433148 2566 leader_election.cc:341] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899): Not found: Tablet not found: 68060330ef1740aab9a13f4dd1dfc5d4
I20260805 22:40:06.433250 2566 leader_election.cc:302] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 639af51b483348a2878b35e1b1996667; no voters: 11cce5d94c824aad8dc6974f6e29dd2d, 3746194b135640ee8c45ff71e8b36bcc
I20260805 22:40:06.433324 2970 raft_consensus.cc:2726] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:40:06.846633 2971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:06.846342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:59427)
0805 22:40:06.846509 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:06.846560 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":73,"threads_started":1}
I20260805 22:40:06.944922 2972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:06.944668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:40805)
0805 22:40:06.944822 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:06.944872 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":72,"threads_started":1}
I20260805 22:40:07.085109 2973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:07.084830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:49463)
0805 22:40:07.085006 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:07.085056 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":92,"threads_started":1}
I20260805 22:40:07.847585 2974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:07.847328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:43323)
0805 22:40:07.847480 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:07.847528 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":67,"threads_started":1}
I20260805 22:40:07.945839 2975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:07.945576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:54725)
0805 22:40:07.945735 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:07.945789 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":72,"threads_started":1}
I20260805 22:40:08.086078 2976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:08.085803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:34243)
0805 22:40:08.085973 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:08.086026 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":75,"threads_started":1}
I20260805 22:40:08.633698 2977 raft_consensus.cc:482] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:40:08.633819 2977 raft_consensus.cc:504] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:08.634058 2977 leader_election.cc:288] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041), 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899)
W20260805 22:40:08.634523 2567 leader_election.cc:341] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041): Not found: Tablet not found: 68060330ef1740aab9a13f4dd1dfc5d4
W20260805 22:40:08.634639 2566 leader_election.cc:341] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899): Not found: Tablet not found: 68060330ef1740aab9a13f4dd1dfc5d4
I20260805 22:40:08.634707 2566 leader_election.cc:302] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 639af51b483348a2878b35e1b1996667; no voters: 11cce5d94c824aad8dc6974f6e29dd2d, 3746194b135640ee8c45ff71e8b36bcc
I20260805 22:40:08.634809 2977 raft_consensus.cc:2726] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:40:08.848379 2978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:08.848062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:56335)
0805 22:40:08.848280 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:08.848328 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":117,"threads_started":1}
I20260805 22:40:08.947072 2979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:08.946635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:55519)
0805 22:40:08.946878 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:08.947019 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":103,"threads_started":1}
I20260805 22:40:09.087518 2980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:09.087023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:49621)
0805 22:40:09.087395 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:09.087463 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":246,"threads_started":1}
I20260805 22:40:09.849220 2981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:09.848965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:51481)
0805 22:40:09.849122 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:09.849168 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":89,"threads_started":1}
I20260805 22:40:09.947923 2982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:09.947675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:49575)
0805 22:40:09.947827 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:09.947873 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":84,"threads_started":1}
I20260805 22:40:10.088438 2983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:10.088174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:33819)
0805 22:40:10.088341 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:10.088386 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":83,"threads_started":1}
I20260805 22:40:10.375993 2984 raft_consensus.cc:482] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:40:10.376109 2984 raft_consensus.cc:504] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:10.376315 2984 leader_election.cc:288] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041), 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899)
W20260805 22:40:10.376786 2566 leader_election.cc:341] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899): Not found: Tablet not found: 68060330ef1740aab9a13f4dd1dfc5d4
W20260805 22:40:10.376878 2567 leader_election.cc:341] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041): Not found: Tablet not found: 68060330ef1740aab9a13f4dd1dfc5d4
I20260805 22:40:10.376925 2567 leader_election.cc:302] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 639af51b483348a2878b35e1b1996667; no voters: 11cce5d94c824aad8dc6974f6e29dd2d, 3746194b135640ee8c45ff71e8b36bcc
I20260805 22:40:10.377002 2984 raft_consensus.cc:2726] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:40:10.850045 2985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:10.849798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:58087)
0805 22:40:10.849940 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:10.849994 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
I20260805 22:40:10.948652 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:10.948415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:52355)
0805 22:40:10.948556 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:10.948602 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260805 22:40:11.089280 2987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:11.089041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:34535)
0805 22:40:11.089183 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:11.089230 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":72,"threads_started":1}
I20260805 22:40:11.850903 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:11.850635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:51053)
0805 22:40:11.850798 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:11.850849 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260805 22:40:11.949532 2989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:11.949277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:35005)
0805 22:40:11.949435 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:11.949482 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
I20260805 22:40:12.090236 2990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:12.089902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:49459)
0805 22:40:12.090133 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:12.090185 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":81,"threads_started":1}
I20260805 22:40:12.851768 2991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:12.851515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:45473)
0805 22:40:12.851675 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:12.851718 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":73,"threads_started":1}
I20260805 22:40:12.950572 2992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:12.950314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:51817)
0805 22:40:12.950460 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:12.950510 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":70,"threads_started":1}
I20260805 22:40:13.091423 2993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:13.090964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:57951)
0805 22:40:13.091292 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:13.091362 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":125,"threads_started":1}
I20260805 22:40:13.852614 2994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:13.852348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:38971)
0805 22:40:13.852512 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:13.852562 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260805 22:40:13.951479 2995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:13.951214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:57243)
0805 22:40:13.951378 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:13.951428 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260805 22:40:14.092510 2996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:14.092228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:38109)
0805 22:40:14.092400 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:14.092455 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":77,"threads_started":1}
I20260805 22:40:14.617297 2997 raft_consensus.cc:482] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:40:14.617399 2997 raft_consensus.cc:504] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cce5d94c824aad8dc6974f6e29dd2d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43041 } } peers { permanent_uuid: "3746194b135640ee8c45ff71e8b36bcc" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38899 } } peers { permanent_uuid: "639af51b483348a2878b35e1b1996667" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 34435 } }
I20260805 22:40:14.617630 2997 leader_election.cc:288] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041), 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899)
W20260805 22:40:14.618085 2567 leader_election.cc:341] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 11cce5d94c824aad8dc6974f6e29dd2d (127.19.77.131:43041): Not found: Tablet not found: 68060330ef1740aab9a13f4dd1dfc5d4
W20260805 22:40:14.618204 2566 leader_election.cc:341] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3746194b135640ee8c45ff71e8b36bcc (127.19.77.130:38899): Not found: Tablet not found: 68060330ef1740aab9a13f4dd1dfc5d4
I20260805 22:40:14.618283 2566 leader_election.cc:302] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 639af51b483348a2878b35e1b1996667; no voters: 11cce5d94c824aad8dc6974f6e29dd2d, 3746194b135640ee8c45ff71e8b36bcc
I20260805 22:40:14.618376 2997 raft_consensus.cc:2726] T 68060330ef1740aab9a13f4dd1dfc5d4 P 639af51b483348a2878b35e1b1996667 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:40:14.853438 2999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:14.853190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:34033)
0805 22:40:14.853340 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:14.853387 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":68,"threads_started":1}
I20260805 22:40:14.952291 3000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:14.952018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:39007)
0805 22:40:14.952189 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:14.952238 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":75,"threads_started":1}
I20260805 22:40:15.093426 3001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:15.093170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:36445)
0805 22:40:15.093330 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:15.093377 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":71,"threads_started":1}
I20260805 22:40:15.854375 3002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:15.854163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:39531)
0805 22:40:15.854287 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:15.854325 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260805 22:40:15.953122 3003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:15.952847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:44261)
0805 22:40:15.953002 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:15.953053 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":71,"threads_started":1}
I20260805 22:40:16.094313 3004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:16.094036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:33877)
0805 22:40:16.094216 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:16.094265 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":89,"threads_started":1}
I20260805 22:40:16.855401 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:16.855081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:37301)
0805 22:40:16.855300 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:16.855349 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":121,"threads_started":1}
I20260805 22:40:16.953887 3006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:16.953671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:58481)
0805 22:40:16.953803 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:16.953838 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":67,"threads_started":1}
I20260805 22:40:17.095276 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:17.094935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:38071)
0805 22:40:17.095092 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:17.095213 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":70,"threads_started":1}
I20260805 22:40:17.856272 3008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:17.855994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.129:36629)
0805 22:40:17.856176 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:17.856224 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":83,"threads_started":1}
I20260805 22:40:17.954873 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:17.954583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.130:39709)
0805 22:40:17.954764 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:17.954816 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":78,"threads_started":1}
I20260805 22:40:18.083684 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 2519
I20260805 22:40:18.090585 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 2688
I20260805 22:40:18.096169 3010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:18.095921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:41221 (local address 127.19.77.131:60553)
0805 22:40:18.096073 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:18.096111 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:41221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260805 22:40:18.097095 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 2821
2026-08-05T22:40:18Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18596 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:40:18 dist-test-slave-chsk krb5kdc[3013](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:40:18 dist-test-slave-chsk krb5kdc[3013](info): set up 2 sockets
Aug 05 22:40:18 dist-test-slave-chsk krb5kdc[3013](info): commencing operation
krb5kdc: starting...
W20260805 22:40:19.154958 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:40:19 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:40:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:40:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:40:19.295886 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34869
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:34869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:19.383958 3027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:19.384238 3027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:19.384279 3027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:19.385535 3027 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 22:40:19.385610 3027 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 22:40:19.385632 3027 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 22:40:19.385653 3027 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:40:19.385686 3027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:19.385711 3027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:19.385751 3027 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:40:19.385782 3027 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:40:19.387499 3027 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:34869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:19.387814 3027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:19.388070 3027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:40:19.393707 3027 server_base.cc:1034] running on GCE node
W20260805 22:40:19.393637 3033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:19.393661 3035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:19.393661 3032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:19.394209 3027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:19.394542 3027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:19.395695 3027 hybrid_clock.cc:648] HybridClock initialized: now 1785969619395676 us; error 44 us; skew 500 ppm
Aug 05 22:40:19 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:19.398408 3027 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:40:19.398913 3027 webserver.cc:460] Webserver started at http://127.19.77.190:32871/ using document root <none> and password file <none>
I20260805 22:40:19.399111 3027 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:19.399221 3027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:19.399328 3027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:40:19.400477 3027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "35a3653543ea4cf1a561283e23fd55a4"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "8a7c22c76906b84d2b1e513ebdf20331"
server_key_iv: "672aaa579fb8e6cd3c88ae6c2abb3412"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.400805 3027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "35a3653543ea4cf1a561283e23fd55a4"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "8a7c22c76906b84d2b1e513ebdf20331"
server_key_iv: "672aaa579fb8e6cd3c88ae6c2abb3412"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.402304 3027 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:40:19.403347 3042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:19.403600 3027 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:40:19.403713 3027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "35a3653543ea4cf1a561283e23fd55a4"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "8a7c22c76906b84d2b1e513ebdf20331"
server_key_iv: "672aaa579fb8e6cd3c88ae6c2abb3412"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.403838 3027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:19.426746 3027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:19.429113 3027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:19.429320 3027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:19.433950 3027 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:34869
I20260805 22:40:19.433995 3094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:34869 every 8 connection(s)
I20260805 22:40:19.434394 3027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:40:19.435372 3095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:19.437817 3095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Bootstrap starting.
I20260805 22:40:19.438485 3095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:19.438915 3095 log.cc:824] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:19.439986 3095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: No bootstrap required, opened a new log
I20260805 22:40:19.441660 3095 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:40:19.441816 3095 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:19.441840 3095 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35a3653543ea4cf1a561283e23fd55a4, State: Initialized, Role: FOLLOWER
I20260805 22:40:19.442015 3095 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:40:19.442106 3095 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:40:19.442130 3095 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:40:19.442160 3095 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:19.442766 3095 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:40:19.442860 3095 leader_election.cc:302] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35a3653543ea4cf1a561283e23fd55a4; no voters:
I20260805 22:40:19.443038 3095 leader_election.cc:288] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:40:19.443094 3098 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:40:19.443249 3098 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 1 LEADER]: Becoming Leader. State: Replica: 35a3653543ea4cf1a561283e23fd55a4, State: Running, Role: LEADER
I20260805 22:40:19.443362 3095 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:40:19.443395 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 3027
I20260805 22:40:19.443493 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:40:19.443676 19766 external_mini_cluster.cc:1428] Setting key a05608ed432c926701347b1497d8291b
I20260805 22:40:19.443325 3098 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:40:19.444734 3099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35a3653543ea4cf1a561283e23fd55a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } } }
I20260805 22:40:19.444737 3100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35a3653543ea4cf1a561283e23fd55a4. Latest consensus state: current_term: 1 leader_uuid: "35a3653543ea4cf1a561283e23fd55a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } } }
I20260805 22:40:19.444864 3099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:40:19.444876 3100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:40:19.445225 3116 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:40:19.445962 3116 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:40:19.447820 3116 catalog_manager.cc:1347] Generated new cluster ID: c64a6ff49b8d46e1a2cfc70c15a1ff22
I20260805 22:40:19.447890 3116 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:40:19 dist-test-slave-chsk krb5kdc[3013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:19.454319 3116 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:40:19.455091 3116 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:40:19.457029 3108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:19.444318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43006 (local address 127.19.77.190:34869)
0805 22:40:19.444597 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:19.444608 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:19.444749 (+ 141us) server_negotiation.cc:407] Connection header received
0805 22:40:19.445066 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:19.445074 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:19.445139 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:19.446210 (+ 1071us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:19.446295 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:19.447563 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:19.448694 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:19.449370 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:19.449498 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:19.452581 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:19.452587 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:19.452588 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:19.452604 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:19.454906 (+ 2302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:19.455408 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:19.455412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:19.455412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:19.455531 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:19.455775 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:19.455776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:19.455776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:19.456069 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:19.456217 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:19.456620 (+ 403us) server_negotiation.cc:299] Negotiation successful
0805 22:40:19.456793 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":73,"threads_started":1}
I20260805 22:40:19.458855 3116 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Generated new TSK 0
I20260805 22:40:19.459069 3116 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:40:19.488636 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34869
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:19.581858 3122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:19.582134 3122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:19.582186 3122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:19.583451 3122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:19.583503 3122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:19.583535 3122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:40:19.585070 3122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:19.585301 3122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:19.585505 3122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:19.590961 3127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:19.590986 3130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:19.590979 3128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:19.591060 3122 server_base.cc:1034] running on GCE node
I20260805 22:40:19.591487 3122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:19.591744 3122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:19.592949 3122 hybrid_clock.cc:648] HybridClock initialized: now 1785969619592927 us; error 42 us; skew 500 ppm
Aug 05 22:40:19 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:19.596889 3122 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:40:19.597457 3122 webserver.cc:460] Webserver started at http://127.19.77.129:37979/ using document root <none> and password file <none>
I20260805 22:40:19.597759 3122 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:19.597834 3122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:19.597998 3122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:40:19.599265 3122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "ccbc207367461bddc7482239e4595128"
server_key_iv: "6a15151c90fb1bff2ef2fa2f82140fe4"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.599675 3122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "ccbc207367461bddc7482239e4595128"
server_key_iv: "6a15151c90fb1bff2ef2fa2f82140fe4"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.601186 3122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:40:19.602039 3137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:19.602216 3122 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:19.602329 3122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "ccbc207367461bddc7482239e4595128"
server_key_iv: "6a15151c90fb1bff2ef2fa2f82140fe4"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.602413 3122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:19.627995 3122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:19.630358 3122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:19.630560 3122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:19.630841 3122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:19.631214 3122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:19.631274 3122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:19.631319 3122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:19.631350 3122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:19.639417 3122 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:42419
I20260805 22:40:19.639477 3253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:42419 every 8 connection(s)
I20260805 22:40:19.639986 3122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:40:19.645562 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 3122
I20260805 22:40:19.645745 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:40:19.645965 19766 external_mini_cluster.cc:1428] Setting key e6960a594d6c31f7ed620813ce737b02
Aug 05 22:40:19 dist-test-slave-chsk krb5kdc[3013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:19.653347 3108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:19.640931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:46247 (local address 127.19.77.190:34869)
0805 22:40:19.641001 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:19.641017 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:19.641473 (+ 456us) server_negotiation.cc:407] Connection header received
0805 22:40:19.642214 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:19.642216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:19.642233 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:19.642306 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:19.644085 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:19.644781 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:19.645967 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:19.646324 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:19.646406 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:19.649319 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:19.649321 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:19.649321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:19.649332 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:19.651269 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:19.652053 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:19.652054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:19.652055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:19.652119 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:19.652463 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:19.652464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:19.652464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:19.652613 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:19.652674 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:19.653073 (+ 399us) server_negotiation.cc:299] Negotiation successful
0805 22:40:19.653195 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:40:19.653460 3256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:19.640899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:46247)
0805 22:40:19.641091 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:19.641273 (+ 182us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:19.642068 (+ 795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:19.642431 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:19.642436 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:19.643378 (+ 942us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:19.643890 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:19.643906 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:19.644892 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:19.644893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:19.645866 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:19.645869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:19.646631 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:19.646632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:19.646819 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:19.647508 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:19.647517 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:19.649203 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:19.651390 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:19.651408 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:19.651412 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:19.651952 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:19.652200 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:19.652201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:19.652202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:19.652367 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:19.652691 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:19.652699 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:19.652896 (+ 197us) client_negotiation.cc:769] Sending connection context
0805 22:40:19.653030 (+ 134us) client_negotiation.cc:240] Negotiation successful
0805 22:40:19.653245 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":90,"threads_started":1}
I20260805 22:40:19.654191 3254 heartbeater.cc:347] Connected to a master server at 127.19.77.190:34869
I20260805 22:40:19.654323 3254 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:19.654572 3254 heartbeater.cc:511] Master 127.19.77.190:34869 requested a full tablet report, sending...
I20260805 22:40:19.655282 3059 ts_manager.cc:194] Registered new tserver with Master: 2d41dd4c3d494c8d8fcbb33763edf1a5 (127.19.77.129:42419)
I20260805 22:40:19.655925 3059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:46247
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:40:19.679390 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34869
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:19.776355 3260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:19.776635 3260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:19.776664 3260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:19.777917 3260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:19.777982 3260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:19.778013 3260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:40:19.779698 3260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:19.780001 3260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:19.780264 3260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:19.785715 3266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:19.785828 3260 server_base.cc:1034] running on GCE node
W20260805 22:40:19.785717 3265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:19.785739 3268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:19.786293 3260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:19.786631 3260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:19.787794 3260 hybrid_clock.cc:648] HybridClock initialized: now 1785969619787770 us; error 41 us; skew 500 ppm
Aug 05 22:40:19 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:19.790602 3260 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:40:19.791191 3260 webserver.cc:460] Webserver started at http://127.19.77.130:39423/ using document root <none> and password file <none>
I20260805 22:40:19.791450 3260 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:19.791523 3260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:19.791694 3260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:40:19.792793 3260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "0eba07bb07fd48b1981c34fb35d35455"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "893cc7da923c8a83a05b238351209b8c"
server_key_iv: "3b3c304d85bfc17999cbddad78c3c68c"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.793185 3260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "0eba07bb07fd48b1981c34fb35d35455"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "893cc7da923c8a83a05b238351209b8c"
server_key_iv: "3b3c304d85bfc17999cbddad78c3c68c"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.794652 3260 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:40:19.795528 3275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:19.795730 3260 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:19.795849 3260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "0eba07bb07fd48b1981c34fb35d35455"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "893cc7da923c8a83a05b238351209b8c"
server_key_iv: "3b3c304d85bfc17999cbddad78c3c68c"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.795938 3260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:19.829478 3260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:19.833099 3260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:19.833344 3260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:19.833643 3260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:19.834038 3260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:19.834115 3260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:19.834152 3260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:19.834182 3260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:19.842882 3260 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:38347
I20260805 22:40:19.842952 3390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:38347 every 8 connection(s)
I20260805 22:40:19.843397 3260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:40:19.846494 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 3260
I20260805 22:40:19.846634 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:40:19.846853 19766 external_mini_cluster.cc:1428] Setting key a316edf0b816a0a98a7109a97b0ab1a6
Aug 05 22:40:19 dist-test-slave-chsk krb5kdc[3013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:19.855439 3108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:19.844476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:38727 (local address 127.19.77.190:34869)
0805 22:40:19.844571 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:19.844573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:19.844945 (+ 372us) server_negotiation.cc:407] Connection header received
0805 22:40:19.845552 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:19.845562 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:19.845576 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:19.845639 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:19.846999 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:19.847735 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:19.848823 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:19.849159 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:19.849240 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:19.852037 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:19.852039 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:19.852039 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:19.852047 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:19.853694 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:19.854184 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:19.854185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:19.854185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:19.854256 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:19.854524 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:19.854525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:19.854525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:19.854660 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:19.854735 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:19.855228 (+ 493us) server_negotiation.cc:299] Negotiation successful
0805 22:40:19.855329 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260805 22:40:19.855679 3393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:19.844485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:38727)
0805 22:40:19.844790 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:19.844836 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:19.845431 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:19.845725 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:19.845729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:19.846517 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:19.846858 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:19.846866 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:19.847841 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:19.847842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:19.848714 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:19.848717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:19.849273 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:19.849274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:19.849393 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:19.850079 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:19.850088 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:19.851886 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:19.853815 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:19.853826 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:19.853829 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:19.854096 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:19.854331 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:19.854332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:19.854332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:19.854451 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:19.854738 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:19.854746 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:19.855005 (+ 259us) client_negotiation.cc:769] Sending connection context
0805 22:40:19.855204 (+ 199us) client_negotiation.cc:240] Negotiation successful
0805 22:40:19.855415 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":132,"threads_started":1}
I20260805 22:40:19.856230 3391 heartbeater.cc:347] Connected to a master server at 127.19.77.190:34869
I20260805 22:40:19.856333 3391 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:19.856539 3391 heartbeater.cc:511] Master 127.19.77.190:34869 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
I20260805 22:40:19.856951 3059 ts_manager.cc:194] Registered new tserver with Master: 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347)
I20260805 22:40:19.857381 3059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:38727
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:40:19.878789 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34869
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:19.969386 3396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:19.969645 3396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:19.969673 3396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:19.970885 3396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:19.970929 3396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:19.970959 3396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:40:19.972647 3396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:19.972885 3396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:19.973088 3396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:19.980247 3404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:19.980285 3401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:19.980423 3402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:19.980726 3396 server_base.cc:1034] running on GCE node
I20260805 22:40:19.981143 3396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:19.981457 3396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:19.982637 3396 hybrid_clock.cc:648] HybridClock initialized: now 1785969619982622 us; error 41 us; skew 500 ppm
Aug 05 22:40:19 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:19.985800 3396 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:40:19.986342 3396 webserver.cc:460] Webserver started at http://127.19.77.131:38603/ using document root <none> and password file <none>
I20260805 22:40:19.986596 3396 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:19.986671 3396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:19.986835 3396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:40:19.988056 3396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "d16bca238e954f63a29b2b429044810c"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "58dacf796d445cb7c854d956c3a6201e"
server_key_iv: "10dcebd8675a80bd4aaf047b847fb287"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.988461 3396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "d16bca238e954f63a29b2b429044810c"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "58dacf796d445cb7c854d956c3a6201e"
server_key_iv: "10dcebd8675a80bd4aaf047b847fb287"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.990172 3396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:40:19.991415 3412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:19.991668 3396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260805 22:40:19.991767 3396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "d16bca238e954f63a29b2b429044810c"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "58dacf796d445cb7c854d956c3a6201e"
server_key_iv: "10dcebd8675a80bd4aaf047b847fb287"
server_key_version: "encryptionkey@0"
I20260805 22:40:19.991840 3396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:20.010790 3396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:20.013439 3396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:20.013585 3396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:20.013803 3396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:20.014186 3396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:20.014225 3396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:20.014250 3396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:20.014298 3396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:20.020838 3396 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:33721
I20260805 22:40:20.020962 3526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:33721 every 8 connection(s)
I20260805 22:40:20.021312 3396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:40:20.025544 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 3396
I20260805 22:40:20.025653 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:40:20.025837 19766 external_mini_cluster.cc:1428] Setting key 72f0e553476e769de27ef37ce98c0a34
Aug 05 22:40:20 dist-test-slave-chsk krb5kdc[3013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:20.031733 3108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.022210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:36255 (local address 127.19.77.190:34869)
0805 22:40:20.022267 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:20.022271 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:20.022474 (+ 203us) server_negotiation.cc:407] Connection header received
0805 22:40:20.023068 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:20.023069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:20.023082 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:20.023157 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:20.024223 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.024760 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.026144 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.026434 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.026543 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.028880 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:20.028882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:20.028882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:20.028891 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:20.030198 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:20.030642 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:20.030643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:20.030644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:20.030713 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:20.030981 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:20.030982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:20.030982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:20.031115 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:20.031227 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:20.031528 (+ 301us) server_negotiation.cc:299] Negotiation successful
0805 22:40:20.031637 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:40:20.031934 3529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.022152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:36255)
0805 22:40:20.022321 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:20.022372 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:20.022932 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:20.023252 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:20.023257 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:20.023873 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:20.024109 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.024115 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.024877 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.024878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.026048 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.026051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.026561 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.026562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.026702 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.027278 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:20.027287 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:20.028765 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:20.030290 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:20.030300 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:20.030302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:20.030546 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:20.030787 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:20.030788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:20.030789 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:20.030903 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:20.031220 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:20.031229 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:20.031381 (+ 152us) client_negotiation.cc:769] Sending connection context
0805 22:40:20.031496 (+ 115us) client_negotiation.cc:240] Negotiation successful
0805 22:40:20.031677 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
I20260805 22:40:20.032544 3527 heartbeater.cc:347] Connected to a master server at 127.19.77.190:34869
I20260805 22:40:20.032639 3527 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:20.032868 3527 heartbeater.cc:511] Master 127.19.77.190:34869 requested a full tablet report, sending...
I20260805 22:40:20.033315 3059 ts_manager.cc:194] Registered new tserver with Master: d16bca238e954f63a29b2b429044810c (127.19.77.131:33721)
I20260805 22:40:20.033676 3059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:36255
I20260805 22:40:20.037760 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:40:20.045941 3108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.039211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43014 (local address 127.19.77.190:34869)
0805 22:40:20.039255 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:20.039257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:20.039393 (+ 136us) server_negotiation.cc:407] Connection header received
0805 22:40:20.039435 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:20.039436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:20.039444 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:20.039492 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:20.040231 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.040727 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.041495 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.041694 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.041749 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.043036 (+ 1287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:20.043037 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:20.043037 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:20.043044 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:20.044772 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:20.045193 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:20.045195 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:20.045195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:20.045258 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:20.045438 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:20.045439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:20.045439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:20.045613 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:20.045698 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:20.045805 (+ 107us) server_negotiation.cc:299] Negotiation successful
0805 22:40:20.045871 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:40:20.047744 3059 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43014:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:40:20.049386 3059 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:40:20.056679 3541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.052182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:38347 (local address 127.0.0.1:45158)
0805 22:40:20.052562 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:20.052574 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:20.052647 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:20.053067 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:20.053068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:20.053070 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:20.053124 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.053126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.054173 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.054174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.055416 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.055419 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.056316 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.056317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.056424 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.056439 (+ 15us) client_negotiation.cc:769] Sending connection context
0805 22:40:20.056517 (+ 78us) client_negotiation.cc:240] Negotiation successful
0805 22:40:20.056585 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":50,"threads_started":1}
I20260805 22:40:20.056921 3539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.052179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42419 (local address 127.0.0.1:37930)
0805 22:40:20.052384 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:20.052541 (+ 157us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:20.052666 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:20.053017 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:20.053020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:20.053023 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:20.053111 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.053114 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.054535 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.054536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.055664 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.055667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.056658 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.056659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.056733 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.056737 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:40:20.056787 (+ 50us) client_negotiation.cc:240] Negotiation successful
0805 22:40:20.056834 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":1,"thread_start_us":124,"threads_started":1}
I20260805 22:40:20.056996 3543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.052598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45158 (local address 127.19.77.130:38347)
0805 22:40:20.052839 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:20.052842 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:20.052869 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:40:20.052912 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:20.052914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:20.052931 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:20.053018 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:20.053220 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.054060 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.055495 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.056215 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.056289 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.056358 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:20.056842 (+ 484us) server_negotiation.cc:299] Negotiation successful
0805 22:40:20.056898 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":116,"threads_started":1}
I20260805 22:40:20.057020 3542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.052522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.19.77.131:33721)
0805 22:40:20.052731 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:20.052736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:20.053235 (+ 499us) server_negotiation.cc:407] Connection header received
0805 22:40:20.053285 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:20.053288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:20.053305 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:20.053386 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:20.053536 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.054582 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.055845 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.056542 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.056600 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.056649 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:20.056882 (+ 233us) server_negotiation.cc:299] Negotiation successful
0805 22:40:20.056925 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":96,"threads_started":1}
I20260805 22:40:20.057180 3540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.052294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37930 (local address 127.19.77.129:42419)
0805 22:40:20.052451 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:20.052456 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:20.052627 (+ 171us) server_negotiation.cc:407] Connection header received
0805 22:40:20.052782 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:20.052785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:20.052802 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:20.052925 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:20.053244 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.054407 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.055767 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.056480 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.056560 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.056620 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:20.057044 (+ 424us) server_negotiation.cc:299] Negotiation successful
0805 22:40:20.057097 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260805 22:40:20.057191 3538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.052412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33721 (local address 127.0.0.1:36526)
0805 22:40:20.053110 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:20.053122 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:20.053171 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:20.053405 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:20.053406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:20.053408 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:20.053446 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.053448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.054694 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.054695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.055747 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.055751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.056678 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.056678 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.056732 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.056736 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:40:20.056787 (+ 51us) client_negotiation.cc:240] Negotiation successful
0805 22:40:20.056834 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"mutex_wait_us":2,"thread_start_us":92,"threads_started":1}
I20260805 22:40:20.057988 3460 tablet_service.cc:1467] Processing CreateTablet for tablet 5df14074d1fa468c8c6e36286253aa7b (DEFAULT_TABLE table=test-table [id=20f8279d7bda41b09c050e1cff9b9c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:20.057972 3324 tablet_service.cc:1467] Processing CreateTablet for tablet 5df14074d1fa468c8c6e36286253aa7b (DEFAULT_TABLE table=test-table [id=20f8279d7bda41b09c050e1cff9b9c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:20.058189 3186 tablet_service.cc:1467] Processing CreateTablet for tablet 5df14074d1fa468c8c6e36286253aa7b (DEFAULT_TABLE table=test-table [id=20f8279d7bda41b09c050e1cff9b9c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:20.058408 3460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5df14074d1fa468c8c6e36286253aa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:20.058408 3324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5df14074d1fa468c8c6e36286253aa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:20.058498 3186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5df14074d1fa468c8c6e36286253aa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:20.061631 3544 tablet_bootstrap.cc:492] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: Bootstrap starting.
I20260805 22:40:20.062374 3544 tablet_bootstrap.cc:654] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:20.062644 3546 tablet_bootstrap.cc:492] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Bootstrap starting.
I20260805 22:40:20.063083 3544 log.cc:824] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:20.063479 3546 tablet_bootstrap.cc:654] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:20.064083 3546 log.cc:824] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:20.064172 3544 tablet_bootstrap.cc:492] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: No bootstrap required, opened a new log
I20260805 22:40:20.064235 3544 ts_tablet_manager.cc:1397] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:40:20.062413 3545 tablet_bootstrap.cc:492] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: Bootstrap starting.
I20260805 22:40:20.065088 3545 tablet_bootstrap.cc:654] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:20.065670 3545 log.cc:824] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:20.066581 3545 tablet_bootstrap.cc:492] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: No bootstrap required, opened a new log
I20260805 22:40:20.066668 3545 ts_tablet_manager.cc:1397] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260805 22:40:20.066668 3544 raft_consensus.cc:348] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:20.066887 3544 raft_consensus.cc:374] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:20.066939 3544 raft_consensus.cc:729] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eba07bb07fd48b1981c34fb35d35455, State: Initialized, Role: FOLLOWER
I20260805 22:40:20.067070 3544 consensus_queue.cc:260] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:20.067409 3544 ts_tablet_manager.cc:1428] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260805 22:40:20.067543 3391 heartbeater.cc:503] Master 127.19.77.190:34869 was elected leader, sending a full tablet report...
I20260805 22:40:20.067909 3546 tablet_bootstrap.cc:492] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: No bootstrap required, opened a new log
I20260805 22:40:20.068007 3546 ts_tablet_manager.cc:1397] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260805 22:40:20.068885 3545 raft_consensus.cc:348] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:20.069100 3545 raft_consensus.cc:374] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:20.069156 3545 raft_consensus.cc:729] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d16bca238e954f63a29b2b429044810c, State: Initialized, Role: FOLLOWER
I20260805 22:40:20.069330 3545 consensus_queue.cc:260] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:20.069669 3545 ts_tablet_manager.cc:1428] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:40:20.069706 3527 heartbeater.cc:503] Master 127.19.77.190:34869 was elected leader, sending a full tablet report...
I20260805 22:40:20.070657 3546 raft_consensus.cc:348] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:20.070865 3546 raft_consensus.cc:374] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:20.070897 3546 raft_consensus.cc:729] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d41dd4c3d494c8d8fcbb33763edf1a5, State: Initialized, Role: FOLLOWER
I20260805 22:40:20.071009 3546 consensus_queue.cc:260] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:20.071377 3546 ts_tablet_manager.cc:1428] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260805 22:40:20.071519 3254 heartbeater.cc:503] Master 127.19.77.190:34869 was elected leader, sending a full tablet report...
W20260805 22:40:20.094358 3392 tablet.cc:2369] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:40:20.140915 3255 tablet.cc:2369] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:40:20.197769 3550 raft_consensus.cc:482] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:40:20.197975 3550 raft_consensus.cc:504] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:20.198443 3550 leader_election.cc:288] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d16bca238e954f63a29b2b429044810c (127.19.77.131:33721), 2d41dd4c3d494c8d8fcbb33763edf1a5 (127.19.77.129:42419)
I20260805 22:40:20.201800 3540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.198746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:35093 (local address 127.19.77.129:42419)
0805 22:40:20.198795 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:20.198797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:20.199049 (+ 252us) server_negotiation.cc:407] Connection header received
0805 22:40:20.199092 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:20.199093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:20.199107 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:20.199190 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:20.199343 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.200072 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.201025 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.201410 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.201501 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.201511 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:20.201680 (+ 169us) server_negotiation.cc:299] Negotiation successful
0805 22:40:20.201719 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:40:20.201807 3542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.198803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:57735 (local address 127.19.77.131:33721)
0805 22:40:20.198868 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:20.198897 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:20.198920 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:40:20.198947 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:20.198947 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:20.198955 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:20.199009 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:20.199233 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.200003 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.201003 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.201411 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.201503 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.201512 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:20.201692 (+ 180us) server_negotiation.cc:299] Negotiation successful
0805 22:40:20.201732 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:40:20.201828 3393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.198687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33721 (local address 127.19.77.130:57735)
0805 22:40:20.198752 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:20.198765 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:20.198818 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:20.199035 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:20.199036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:20.199039 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:20.199125 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.199126 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.200110 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.200112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.200892 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.200896 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.201503 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.201504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.201595 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.201597 (+ 2us) client_negotiation.cc:769] Sending connection context
0805 22:40:20.201683 (+ 86us) client_negotiation.cc:240] Negotiation successful
0805 22:40:20.201730 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 22:40:20.201853 3553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.198689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42419 (local address 127.19.77.130:35093)
0805 22:40:20.198939 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:20.198951 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:20.199032 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:20.199198 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:20.199199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:20.199201 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:20.199276 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.199278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.200142 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.200143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.200920 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:20.200922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.201500 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.201501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:20.201587 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.201591 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:40:20.201662 (+ 71us) client_negotiation.cc:240] Negotiation successful
0805 22:40:20.201709 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":19,"thread_start_us":152,"threads_started":1}
I20260805 22:40:20.202253 3206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5df14074d1fa468c8c6e36286253aa7b" candidate_uuid: "0eba07bb07fd48b1981c34fb35d35455" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" is_pre_election: true
I20260805 22:40:20.202253 3480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5df14074d1fa468c8c6e36286253aa7b" candidate_uuid: "0eba07bb07fd48b1981c34fb35d35455" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d16bca238e954f63a29b2b429044810c" is_pre_election: true
I20260805 22:40:20.202430 3206 raft_consensus.cc:2454] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0eba07bb07fd48b1981c34fb35d35455 in term 0.
I20260805 22:40:20.202430 3480 raft_consensus.cc:2454] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0eba07bb07fd48b1981c34fb35d35455 in term 0.
I20260805 22:40:20.202672 3276 leader_election.cc:302] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eba07bb07fd48b1981c34fb35d35455, 2d41dd4c3d494c8d8fcbb33763edf1a5; no voters:
I20260805 22:40:20.202805 3550 raft_consensus.cc:2781] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:40:20.202890 3550 raft_consensus.cc:482] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:40:20.202926 3550 raft_consensus.cc:3037] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:20.203787 3550 raft_consensus.cc:504] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:20.203967 3550 leader_election.cc:288] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [CANDIDATE]: Term 1 election: Requested vote from peers d16bca238e954f63a29b2b429044810c (127.19.77.131:33721), 2d41dd4c3d494c8d8fcbb33763edf1a5 (127.19.77.129:42419)
I20260805 22:40:20.204133 3480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5df14074d1fa468c8c6e36286253aa7b" candidate_uuid: "0eba07bb07fd48b1981c34fb35d35455" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d16bca238e954f63a29b2b429044810c"
I20260805 22:40:20.204198 3206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5df14074d1fa468c8c6e36286253aa7b" candidate_uuid: "0eba07bb07fd48b1981c34fb35d35455" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5"
I20260805 22:40:20.204244 3480 raft_consensus.cc:3037] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:20.204308 3206 raft_consensus.cc:3037] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:20.205030 3480 raft_consensus.cc:2454] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0eba07bb07fd48b1981c34fb35d35455 in term 1.
I20260805 22:40:20.205155 3206 raft_consensus.cc:2454] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0eba07bb07fd48b1981c34fb35d35455 in term 1.
I20260805 22:40:20.205273 3277 leader_election.cc:302] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eba07bb07fd48b1981c34fb35d35455, d16bca238e954f63a29b2b429044810c; no voters:
I20260805 22:40:20.205430 3550 raft_consensus.cc:2781] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:40:20.205603 3550 raft_consensus.cc:686] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 1 LEADER]: Becoming Leader. State: Replica: 0eba07bb07fd48b1981c34fb35d35455, State: Running, Role: LEADER
I20260805 22:40:20.205724 3550 consensus_queue.cc:237] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:20.206672 3059 catalog_manager.cc:5495] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130). New cstate: current_term: 1 leader_uuid: "0eba07bb07fd48b1981c34fb35d35455" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260805 22:40:20.241133 3543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.238425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45174 (local address 127.19.77.130:38347)
0805 22:40:20.238499 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:20.238501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:20.238512 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:40:20.238619 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:20.238620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:20.238643 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:20.238731 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:40:20.238894 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.239445 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.240276 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:20.240476 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:20.240556 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:20.240753 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:40:20.240863 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:40:20.240964 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:20.240986 (+ 22us) server_negotiation.cc:299] Negotiation successful
0805 22:40:20.241008 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:40:20.243345 3480 raft_consensus.cc:1261] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c [term 1 FOLLOWER]: Refusing update from remote peer 0eba07bb07fd48b1981c34fb35d35455: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:40:20.243364 3206 raft_consensus.cc:1261] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Refusing update from remote peer 0eba07bb07fd48b1981c34fb35d35455: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:40:20.243757 3550 consensus_queue.cc:1035] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:40:20.244033 3554 consensus_queue.cc:1035] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:40:20.246912 3557 mvcc.cc:205] Tried to move back new op lower bound from 7315331564513054720 to 7315331564363341824. Current Snapshot: MvccSnapshot[applied={T|T < 7315331564513054720}]
I20260805 22:40:20.247566 3558 mvcc.cc:205] Tried to move back new op lower bound from 7315331564513054720 to 7315331564363341824. Current Snapshot: MvccSnapshot[applied={T|T < 7315331564513054720}]
I20260805 22:40:20.247712 3559 mvcc.cc:205] Tried to move back new op lower bound from 7315331564513054720 to 7315331564363341824. Current Snapshot: MvccSnapshot[applied={T|T < 7315331564513054720}]
I20260805 22:40:20.249490 3059 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:40:20.249629 3059 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:40:20.250597 3059 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Sending DeleteTablet for 3 replicas of tablet 5df14074d1fa468c8c6e36286253aa7b
I20260805 22:40:20.251047 3186 tablet_service.cc:1514] Processing DeleteTablet for tablet 5df14074d1fa468c8c6e36286253aa7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:20 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:37930
I20260805 22:40:20.251098 3460 tablet_service.cc:1514] Processing DeleteTablet for tablet 5df14074d1fa468c8c6e36286253aa7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:20 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:36526
I20260805 22:40:20.251335 3324 tablet_service.cc:1514] Processing DeleteTablet for tablet 5df14074d1fa468c8c6e36286253aa7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:20 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:45158
I20260805 22:40:20.251423 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 3122
I20260805 22:40:20.252312 3568 tablet_replica.cc:330] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: stopping tablet replica
I20260805 22:40:20.252472 3568 raft_consensus.cc:2229] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:40:20.252682 3568 raft_consensus.cc:2258] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:20.253278 3568 ts_tablet_manager.cc:1905] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:20.255784 3568 ts_tablet_manager.cc:1918] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:40:20.255882 3568 log.cc:1196] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/5df14074d1fa468c8c6e36286253aa7b
I20260805 22:40:20.256208 3568 ts_tablet_manager.cc:1939] T 5df14074d1fa468c8c6e36286253aa7b P 0eba07bb07fd48b1981c34fb35d35455: Deleting consensus metadata
I20260805 22:40:20.256412 3567 tablet_replica.cc:330] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: stopping tablet replica
I20260805 22:40:20.256578 3567 raft_consensus.cc:2229] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:40:20.256717 3567 raft_consensus.cc:2258] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:20.256937 3044 catalog_manager.cc:4841] TS 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347): tablet 5df14074d1fa468c8c6e36286253aa7b (table test-table [id=20f8279d7bda41b09c050e1cff9b9c05]) successfully deleted
I20260805 22:40:20.257331 3567 ts_tablet_manager.cc:1905] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:20.258791 3567 ts_tablet_manager.cc:1918] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:40:20.258908 3567 log.cc:1196] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/5df14074d1fa468c8c6e36286253aa7b
I20260805 22:40:20.259315 3567 ts_tablet_manager.cc:1939] T 5df14074d1fa468c8c6e36286253aa7b P d16bca238e954f63a29b2b429044810c: Deleting consensus metadata
I20260805 22:40:20.259936 3044 catalog_manager.cc:4841] TS d16bca238e954f63a29b2b429044810c (127.19.77.131:33721): tablet 5df14074d1fa468c8c6e36286253aa7b (table test-table [id=20f8279d7bda41b09c050e1cff9b9c05]) successfully deleted
W20260805 22:40:20.262374 3043 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:42419 (error 108)
I20260805 22:40:20.262531 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 3260
I20260805 22:40:20.264429 3538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:20.264232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42419 (local address 127.0.0.1:37932)
0805 22:40:20.264312 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:20.264371 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:42419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260805 22:40:20.264600 3043 catalog_manager.cc:4584] TS 2d41dd4c3d494c8d8fcbb33763edf1a5 (127.19.77.129:42419): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5df14074d1fa468c8c6e36286253aa7b: Network error: Client connection negotiation failed: client connection to 127.19.77.129:42419: connect: Connection refused (error 111)
I20260805 22:40:20.272831 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 3396
I20260805 22:40:20.279377 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 3027
I20260805 22:40:40.286513 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34869
--webserver_interface=127.19.77.190
--webserver_port=32871
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:34869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:40:40.373282 3570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:40.373517 3570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:40.373551 3570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:40.374728 3570 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 22:40:40.374770 3570 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 22:40:40.374783 3570 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 22:40:40.374795 3570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:40:40.374809 3570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:40.374822 3570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:40.374835 3570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:40:40.374846 3570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:40:40.376372 3570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:34869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=32871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:40.376592 3570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:40.376793 3570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:40.386490 3577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:40.386482 3579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:40.386513 3576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:40.386909 3570 server_base.cc:1034] running on GCE node
I20260805 22:40:40.387279 3570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:40.387645 3570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:40.388810 3570 hybrid_clock.cc:648] HybridClock initialized: now 1785969640388806 us; error 40 us; skew 500 ppm
Aug 05 22:40:40 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969640, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:40.391634 3570 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:40:40.392168 3570 webserver.cc:460] Webserver started at http://127.19.77.190:32871/ using document root <none> and password file <none>
I20260805 22:40:40.392388 3570 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:40.392448 3570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:40.393931 3570 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260805 22:40:40.394709 3586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:40.394929 3570 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:40.395051 3570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "35a3653543ea4cf1a561283e23fd55a4"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "8a7c22c76906b84d2b1e513ebdf20331"
server_key_iv: "672aaa579fb8e6cd3c88ae6c2abb3412"
server_key_version: "encryptionkey@0"
I20260805 22:40:40.395570 3570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:40.420667 3570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:40.423118 3570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:40.423408 3570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:40.427865 3570 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:34869
I20260805 22:40:40.427901 3639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:34869 every 8 connection(s)
I20260805 22:40:40.428339 3570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:40:40.429956 3640 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:40:40.430721 3640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Bootstrap starting.
I20260805 22:40:40.433755 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 3570
I20260805 22:40:40.434118 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:42419
--local_ip_for_outbound_sockets=127.19.77.129
--tserver_master_addrs=127.19.77.190:34869
--webserver_port=37979
--webserver_interface=127.19.77.129
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:40:40.442408 3640 log.cc:824] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:40.444578 3640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:40:40.444942 3640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Bootstrap complete.
I20260805 22:40:40.447815 3640 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:40:40.448271 3640 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35a3653543ea4cf1a561283e23fd55a4, State: Initialized, Role: FOLLOWER
I20260805 22:40:40.448498 3640 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:40:40.448590 3640 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:40:40.448679 3640 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:40:40.448742 3640 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:40:40.450253 3640 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:40:40.450389 3640 leader_election.cc:302] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35a3653543ea4cf1a561283e23fd55a4; no voters:
I20260805 22:40:40.450585 3640 leader_election.cc:288] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:40:40.450654 3644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:40:40.450827 3644 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 2 LEADER]: Becoming Leader. State: Replica: 35a3653543ea4cf1a561283e23fd55a4, State: Running, Role: LEADER
I20260805 22:40:40.450932 3640 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:40:40.450978 3644 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:40:40.451361 3644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35a3653543ea4cf1a561283e23fd55a4. Latest consensus state: current_term: 2 leader_uuid: "35a3653543ea4cf1a561283e23fd55a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } } }
I20260805 22:40:40.451361 3645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "35a3653543ea4cf1a561283e23fd55a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } } }
I20260805 22:40:40.451519 3644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:40:40.451586 3645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:40:40.453236 3659 catalog_manager.cc:1259] Loaded cluster ID: c64a6ff49b8d46e1a2cfc70c15a1ff22
I20260805 22:40:40.453336 3659 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: loading cluster ID for follower catalog manager: success
I20260805 22:40:40.454993 3659 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: acquiring CA information for follower catalog manager: success
I20260805 22:40:40.455891 3659 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:40:40.456053 3660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:40:40.456529 3660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:40:40.456677 3660 catalog_manager.cc:1259] Loaded cluster ID: c64a6ff49b8d46e1a2cfc70c15a1ff22
I20260805 22:40:40.456734 3660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:40:40.456967 3660 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:40:40.457077 3660 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Loaded TSK: 0
I20260805 22:40:40.467011 3660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Generated new TSK 1
I20260805 22:40:40.467134 3660 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:40:40.533069 3642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:40.533317 3642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:40.533345 3642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:40.534708 3642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:40.534768 3642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:40.534801 3642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:40:40.536561 3642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:42419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=37979
--tserver_master_addrs=127.19.77.190:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:40.536867 3642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:40.537159 3642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:40.542786 3667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:40.542786 3668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:40.542779 3670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:40.543236 3642 server_base.cc:1034] running on GCE node
I20260805 22:40:40.543473 3642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:40.543783 3642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:40.544981 3642 hybrid_clock.cc:648] HybridClock initialized: now 1785969640544959 us; error 35 us; skew 500 ppm
Aug 05 22:40:40 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969640, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:40.548552 3642 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:40:40.549209 3642 webserver.cc:460] Webserver started at http://127.19.77.129:37979/ using document root <none> and password file <none>
I20260805 22:40:40.549489 3642 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:40.549577 3642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:40.552560 3642 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260805 22:40:40.553541 3677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:40.553788 3642 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:40.553898 3642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "ccbc207367461bddc7482239e4595128"
server_key_iv: "6a15151c90fb1bff2ef2fa2f82140fe4"
server_key_version: "encryptionkey@0"
I20260805 22:40:40.554409 3642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:40.577365 3642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:40.580353 3642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:40.580519 3642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:40.580806 3642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:40.581310 3684 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260805 22:40:40.583105 3642 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 22:40:40.583225 3642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260805 22:40:40.583263 3642 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260805 22:40:40.584185 3642 ts_tablet_manager.cc:610] Registered 1 tablets
I20260805 22:40:40.584234 3642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260805 22:40:40.584573 3684 tablet_bootstrap.cc:492] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Bootstrap starting.
I20260805 22:40:40.593626 3642 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:42419
I20260805 22:40:40.594216 3642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:40:40.595677 3792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:42419 every 8 connection(s)
I20260805 22:40:40.599128 3684 log.cc:824] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:40.601576 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 3642
I20260805 22:40:40.601908 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:38347
--local_ip_for_outbound_sockets=127.19.77.130
--tserver_master_addrs=127.19.77.190:34869
--webserver_port=39423
--webserver_interface=127.19.77.130
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:40:40.602546 3684 tablet_bootstrap.cc:492] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:40:40.602867 3684 tablet_bootstrap.cc:492] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Bootstrap complete.
I20260805 22:40:40.604501 3684 ts_tablet_manager.cc:1397] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.016s
Aug 05 22:40:40 dist-test-slave-chsk krb5kdc[3013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969640, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:40.606338 3684 raft_consensus.cc:348] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:40.606767 3684 raft_consensus.cc:729] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d41dd4c3d494c8d8fcbb33763edf1a5, State: Initialized, Role: FOLLOWER
I20260805 22:40:40.606949 3684 consensus_queue.cc:260] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:40.607329 3684 ts_tablet_manager.cc:1428] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260805 22:40:40.611090 3796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.595670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:59187 (local address 127.19.77.190:34869)
0805 22:40:40.599487 (+ 3817us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:40.599497 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:40.599569 (+ 72us) server_negotiation.cc:407] Connection header received
0805 22:40:40.599977 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:40.599983 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:40.600046 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:40.600219 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:40.601054 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.602301 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.603934 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.604522 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.604661 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.607193 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:40.607198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:40.607198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:40.607212 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:40.609139 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:40.609663 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:40.609666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:40.609667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:40.609774 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:40.610056 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:40.610057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:40.610058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:40.610320 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:40.610422 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:40.610732 (+ 310us) server_negotiation.cc:299] Negotiation successful
0805 22:40:40.610879 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3764,"thread_start_us":92,"threads_started":1}
I20260805 22:40:40.611104 3795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.595296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:59187)
0805 22:40:40.598674 (+ 3378us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:40.598748 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:40.599709 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:40.600252 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:40.600257 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:40.600615 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:40.600908 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.600914 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.602467 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.602468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.603790 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.603795 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.604660 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.604661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.604807 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.605432 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:40.605441 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:40.606999 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:40.609275 (+ 2276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:40.609284 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:40.609287 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:40.609546 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:40.609864 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:40.609865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:40.609865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:40.609985 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:40.610400 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:40.610408 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:40.610557 (+ 149us) client_negotiation.cc:769] Sending connection context
0805 22:40:40.610677 (+ 120us) client_negotiation.cc:240] Negotiation successful
0805 22:40:40.610877 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3296,"thread_start_us":110,"threads_started":1}
I20260805 22:40:40.611887 3793 heartbeater.cc:347] Connected to a master server at 127.19.77.190:34869
I20260805 22:40:40.611990 3793 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:40.612202 3793 heartbeater.cc:511] Master 127.19.77.190:34869 requested a full tablet report, sending...
I20260805 22:40:40.612983 3603 ts_manager.cc:194] Registered new tserver with Master: 2d41dd4c3d494c8d8fcbb33763edf1a5 (127.19.77.129:42419)
I20260805 22:40:40.614187 3603 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:59187
I20260805 22:40:40.615388 3793 heartbeater.cc:503] Master 127.19.77.190:34869 was elected leader, sending a full tablet report...
Aug 05 22:40:40 dist-test-slave-chsk krb5kdc[3013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969640, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.129@KRBTEST.COM
I20260805 22:40:40.623582 3800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.613630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42419 (local address 127.0.0.1:57518)
0805 22:40:40.614570 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:40.614615 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:40.614710 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:40.614958 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:40.614964 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:40.615374 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:40.615445 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.615449 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.616412 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.616413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.617090 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.617098 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.617604 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.617605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.617714 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.618341 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:40.618347 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:40.619854 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:40.622177 (+ 2323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:40.622190 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:40.622193 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:40.622447 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:40.622720 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:40.622721 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:40.622722 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:40.622789 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:40.623114 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:40.623123 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:40.623212 (+ 89us) client_negotiation.cc:769] Sending connection context
0805 22:40:40.623322 (+ 110us) client_negotiation.cc:240] Negotiation successful
0805 22:40:40.623478 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":905,"thread_start_us":115,"threads_started":1}
I20260805 22:40:40.623584 3801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.613743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57518 (local address 127.19.77.129:42419)
0805 22:40:40.613926 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:40.613931 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:40.614690 (+ 759us) server_negotiation.cc:407] Connection header received
0805 22:40:40.614819 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:40.614823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:40.614848 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:40.614944 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:40.615547 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.616322 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.617193 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.617509 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.617601 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.619975 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:40.619987 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:40.619987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:40.619996 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:40.622043 (+ 2047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:40.622554 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:40.622558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:40.622558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:40.622632 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:40.622868 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:40.622869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:40.622869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:40.623039 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:40.623139 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:40.623366 (+ 227us) server_negotiation.cc:299] Negotiation successful
0805 22:40:40.623470 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":107,"threads_started":1}
I20260805 22:40:40.624156 3714 tablet_service.cc:1514] Processing DeleteTablet for tablet 5df14074d1fa468c8c6e36286253aa7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:20 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:57518
I20260805 22:40:40.624863 3802 tablet_replica.cc:330] stopping tablet replica
I20260805 22:40:40.625002 3802 raft_consensus.cc:2229] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:40:40.625097 3802 raft_consensus.cc:2258] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:40.625464 3802 ts_tablet_manager.cc:1905] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:40.628299 3802 ts_tablet_manager.cc:1918] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:40:40.628470 3802 log.cc:1196] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal/wals/5df14074d1fa468c8c6e36286253aa7b
I20260805 22:40:40.628765 3802 ts_tablet_manager.cc:1939] T 5df14074d1fa468c8c6e36286253aa7b P 2d41dd4c3d494c8d8fcbb33763edf1a5: Deleting consensus metadata
I20260805 22:40:40.629467 3587 catalog_manager.cc:4841] TS 2d41dd4c3d494c8d8fcbb33763edf1a5 (127.19.77.129:42419): tablet 5df14074d1fa468c8c6e36286253aa7b (table test-table [id=20f8279d7bda41b09c050e1cff9b9c05]) successfully deleted
W20260805 22:40:40.694332 3798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:40.694581 3798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:40.694608 3798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:40.695955 3798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:40.696018 3798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:40.696050 3798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:40:40.697763 3798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:38347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=39423
--tserver_master_addrs=127.19.77.190:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:40.698068 3798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:40.698341 3798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:40.703989 3810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:40.704008 3807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:40.704002 3808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:40.704298 3798 server_base.cc:1034] running on GCE node
I20260805 22:40:40.704548 3798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:40.704847 3798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:40.706015 3798 hybrid_clock.cc:648] HybridClock initialized: now 1785969640705997 us; error 41 us; skew 500 ppm
Aug 05 22:40:40 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969640, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:40.708913 3798 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:40:40.709460 3798 webserver.cc:460] Webserver started at http://127.19.77.130:39423/ using document root <none> and password file <none>
I20260805 22:40:40.709774 3798 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:40.709841 3798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:40.711388 3798 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:40:40.712045 3817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:40.712256 3798 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:40.712352 3798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "0eba07bb07fd48b1981c34fb35d35455"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "893cc7da923c8a83a05b238351209b8c"
server_key_iv: "3b3c304d85bfc17999cbddad78c3c68c"
server_key_version: "encryptionkey@0"
I20260805 22:40:40.712706 3798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:40.722983 3798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:40.725884 3798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:40.726020 3798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:40.726239 3798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:40.726603 3798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:40.726644 3798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:40.726670 3798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:40.726718 3798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:40.734004 3798 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:38347
I20260805 22:40:40.734061 3931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:38347 every 8 connection(s)
I20260805 22:40:40.734498 3798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:40:40.740159 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 3798
I20260805 22:40:40.740532 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:33721
--local_ip_for_outbound_sockets=127.19.77.131
--tserver_master_addrs=127.19.77.190:34869
--webserver_port=38603
--webserver_interface=127.19.77.131
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:40:40 dist-test-slave-chsk krb5kdc[3013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969640, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:40.745857 3796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.735427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:43265 (local address 127.19.77.190:34869)
0805 22:40:40.735477 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:40.735480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:40.735724 (+ 244us) server_negotiation.cc:407] Connection header received
0805 22:40:40.736340 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:40.736342 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:40.736360 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:40.736414 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:40.737477 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.738069 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.739289 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.739521 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.739606 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.742654 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:40.742656 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:40.742657 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:40.742667 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:40.744263 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:40.744775 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:40.744777 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:40.744777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:40.744844 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:40.745136 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:40.745137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:40.745137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:40.745267 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:40.745344 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:40.745653 (+ 309us) server_negotiation.cc:299] Negotiation successful
0805 22:40:40.745757 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:40:40.746084 3934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.735408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:43265)
0805 22:40:40.735588 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:40.735632 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:40.736209 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:40.736486 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:40.736491 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:40.737126 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:40.737358 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.737364 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.738192 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.738193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.739192 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.739199 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.739618 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.739619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.739782 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.740671 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:40.740684 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:40.742506 (+ 1822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:40.744381 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:40.744391 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:40.744394 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:40.744665 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:40.744921 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:40.744922 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:40.744922 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:40.745052 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:40.745334 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:40.745343 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:40.745506 (+ 163us) client_negotiation.cc:769] Sending connection context
0805 22:40:40.745633 (+ 127us) client_negotiation.cc:240] Negotiation successful
0805 22:40:40.745819 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":74,"threads_started":1}
I20260805 22:40:40.746546 3932 heartbeater.cc:347] Connected to a master server at 127.19.77.190:34869
I20260805 22:40:40.746650 3932 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:40.746871 3932 heartbeater.cc:511] Master 127.19.77.190:34869 requested a full tablet report, sending...
I20260805 22:40:40.747335 3603 ts_manager.cc:194] Registered new tserver with Master: 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347)
I20260805 22:40:40.747735 3603 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:43265
W20260805 22:40:40.828344 3935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:40:40.828634 3935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:40:40.828677 3935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:40:40.829949 3935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:40:40.830042 3935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:40:40.830093 3935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:40:40.831862 3935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:33721
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=38603
--tserver_master_addrs=127.19.77.190:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:40:40.832190 3935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:40:40.832458 3935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:40:40.838202 3940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:40.838341 3944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:40:40.838217 3941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:40:40.838342 3935 server_base.cc:1034] running on GCE node
I20260805 22:40:40.838811 3935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:40:40.839267 3935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:40:40.840499 3935 hybrid_clock.cc:648] HybridClock initialized: now 1785969640840398 us; error 139 us; skew 500 ppm
Aug 05 22:40:40 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969640, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:40:40.844513 3935 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:40:40.845079 3935 webserver.cc:460] Webserver started at http://127.19.77.131:38603/ using document root <none> and password file <none>
I20260805 22:40:40.845366 3935 fs_manager.cc:359] Metadata directory not provided
I20260805 22:40:40.845471 3935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:40:40.847020 3935 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:40:40.847741 3951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:40.847954 3935 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:40:40.848067 3935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "d16bca238e954f63a29b2b429044810c"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "58dacf796d445cb7c854d956c3a6201e"
server_key_iv: "10dcebd8675a80bd4aaf047b847fb287"
server_key_version: "encryptionkey@0"
I20260805 22:40:40.848464 3935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:40:40.883090 3935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:40:40.885720 3935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:40:40.885931 3935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:40:40.886234 3935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:40:40.886579 3935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:40:40.886637 3935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:40.886680 3935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:40:40.886711 3935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:40:40.892805 3935 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:33721
I20260805 22:40:40.892858 4067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:33721 every 8 connection(s)
I20260805 22:40:40.893229 3935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:40:40.897758 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 3935
Aug 05 22:40:40 dist-test-slave-chsk krb5kdc[3013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969640, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:40:40.904286 3796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.893976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:50789 (local address 127.19.77.190:34869)
0805 22:40:40.894027 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:40.894029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:40.894299 (+ 270us) server_negotiation.cc:407] Connection header received
0805 22:40:40.894945 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:40.894947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:40.894960 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:40.895009 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:40.896107 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.896604 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.897718 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.898021 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.898128 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.900643 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:40.900645 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:40.900645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:40.900654 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:40.902256 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:40.902919 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:40.902921 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:40.902921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:40.903017 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:40.903393 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:40.903394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:40.903394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:40.903576 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:40.903640 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:40.904049 (+ 409us) server_negotiation.cc:299] Negotiation successful
0805 22:40:40.904159 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:40:40.904434 4070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.893973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:50789)
0805 22:40:40.894165 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:40.894208 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:40.894825 (+ 617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:40.895082 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:40.895086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:40.895781 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:40:40.895994 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.895999 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.896718 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.896719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.897612 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.897616 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.898141 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.898143 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.898315 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.898862 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:40:40.898870 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:40:40.900537 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:40:40.902380 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:40.902391 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:40.902393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:40.902781 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:40.903078 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:40:40.903079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:40:40.903079 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:40:40.903298 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:40:40.903660 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:40:40.903667 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:40:40.903850 (+ 183us) client_negotiation.cc:769] Sending connection context
0805 22:40:40.903977 (+ 127us) client_negotiation.cc:240] Negotiation successful
0805 22:40:40.904206 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":89,"threads_started":1}
I20260805 22:40:40.904932 4068 heartbeater.cc:347] Connected to a master server at 127.19.77.190:34869
I20260805 22:40:40.905038 4068 heartbeater.cc:464] Registering TS with master...
I20260805 22:40:40.905257 4068 heartbeater.cc:511] Master 127.19.77.190:34869 requested a full tablet report, sending...
I20260805 22:40:40.905733 3603 ts_manager.cc:194] Registered new tserver with Master: d16bca238e954f63a29b2b429044810c (127.19.77.131:33721)
I20260805 22:40:40.906121 3603 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:50789
I20260805 22:40:40.906665 4072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.898302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58544 (local address 127.19.77.190:34869)
0805 22:40:40.898422 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:40.898425 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:40.898480 (+ 55us) server_negotiation.cc:407] Connection header received
0805 22:40:40.898828 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:40.898829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:40.898839 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:40.898930 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:40.899759 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.900391 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.901482 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.901768 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.901827 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.903542 (+ 1715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:40.903544 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:40.903544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:40.903551 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:40.905384 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:40.905842 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:40.905843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:40.905843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:40.905908 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:40.906126 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:40.906127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:40.906127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:40.906270 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:40.906440 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:40.906528 (+ 88us) server_negotiation.cc:299] Negotiation successful
0805 22:40:40.906601 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
I20260805 22:40:40.907557 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:40:40.910315 4072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.907973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58548 (local address 127.19.77.190:34869)
0805 22:40:40.908018 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:40.908020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:40.908082 (+ 62us) server_negotiation.cc:407] Connection header received
0805 22:40:40.908144 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:40.908144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:40.908174 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:40.908226 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:40:40.908315 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.908773 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.909547 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.909745 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.909797 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.909959 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:40:40.910052 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:40:40.910110 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:40.910206 (+ 96us) server_negotiation.cc:299] Negotiation successful
0805 22:40:40.910227 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:40:40.910665 3603 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:58548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:40:40.912397 3603 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:40:40.914561 3714 tablet_service.cc:1467] Processing CreateTablet for tablet 220bbe2ebf10479d993743f2121df713 (DEFAULT_TABLE table=test-table [id=81ee0d47f1644c4fa723a8f1f0ca3087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:40.914806 3714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 220bbe2ebf10479d993743f2121df713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:40.916378 3684 tablet_bootstrap.cc:492] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Bootstrap starting.
I20260805 22:40:40.916764 3684 tablet_bootstrap.cc:654] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:40.918238 3684 tablet_bootstrap.cc:492] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: No bootstrap required, opened a new log
I20260805 22:40:40.918301 3684 ts_tablet_manager.cc:1397] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260805 22:40:40.918381 3800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.914301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:38347 (local address 127.0.0.1:60494)
0805 22:40:40.914362 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:40.914375 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:40.914424 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:40.914973 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:40.914975 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:40.914977 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:40.915034 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.915036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.916145 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.916146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.917145 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.917147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.918092 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.918093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.918174 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.918194 (+ 20us) client_negotiation.cc:769] Sending connection context
0805 22:40:40.918253 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:40:40.918305 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260805 22:40:40.918394 4076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.914564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60494 (local address 127.19.77.130:38347)
0805 22:40:40.914771 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:40.914776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:40.914787 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:40:40.914829 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:40.914831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:40.914847 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:40.914965 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:40.915097 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.916056 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.917243 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.918010 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.918093 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.918156 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:40.918274 (+ 118us) server_negotiation.cc:299] Negotiation successful
0805 22:40:40.918313 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":97,"threads_started":1}
I20260805 22:40:40.918460 3684 raft_consensus.cc:348] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:40.918570 3684 raft_consensus.cc:374] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:40.918628 3684 raft_consensus.cc:729] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d41dd4c3d494c8d8fcbb33763edf1a5, State: Initialized, Role: FOLLOWER
I20260805 22:40:40.918674 3684 consensus_queue.cc:260] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:40.918766 3684 ts_tablet_manager.cc:1428] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260805 22:40:40.919247 3866 tablet_service.cc:1467] Processing CreateTablet for tablet 220bbe2ebf10479d993743f2121df713 (DEFAULT_TABLE table=test-table [id=81ee0d47f1644c4fa723a8f1f0ca3087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:40.919633 3866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 220bbe2ebf10479d993743f2121df713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:40.920455 4074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.914402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33721 (local address 127.0.0.1:58054)
0805 22:40:40.914753 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:40.914765 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:40.914821 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:40.916701 (+ 1880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:40.916702 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:40.916704 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:40.916746 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.916748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.917927 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.917928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.919135 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:40.919179 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.920210 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.920211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:40.920278 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.920282 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:40:40.920334 (+ 52us) client_negotiation.cc:240] Negotiation successful
0805 22:40:40.920380 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":75,"threads_started":1}
I20260805 22:40:40.920482 4075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:40.914509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58054 (local address 127.19.77.131:33721)
0805 22:40:40.916505 (+ 1996us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:40.916512 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:40.916528 (+ 16us) server_negotiation.cc:407] Connection header received
0805 22:40:40.916584 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:40.916586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:40.916603 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:40.916695 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:40.916798 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.917816 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.919286 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:40.920023 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:40.920085 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:40.920144 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:40.920351 (+ 207us) server_negotiation.cc:299] Negotiation successful
0805 22:40:40.920397 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1955,"thread_start_us":86,"threads_started":1}
I20260805 22:40:40.921080 4001 tablet_service.cc:1467] Processing CreateTablet for tablet 220bbe2ebf10479d993743f2121df713 (DEFAULT_TABLE table=test-table [id=81ee0d47f1644c4fa723a8f1f0ca3087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:40:40.921394 4001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 220bbe2ebf10479d993743f2121df713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:40:40.922905 4078 tablet_bootstrap.cc:492] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: Bootstrap starting.
I20260805 22:40:40.923681 4078 tablet_bootstrap.cc:654] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:40.924294 4078 log.cc:824] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:40.924993 4080 tablet_bootstrap.cc:492] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: Bootstrap starting.
I20260805 22:40:40.925195 4078 tablet_bootstrap.cc:492] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: No bootstrap required, opened a new log
I20260805 22:40:40.925272 4078 ts_tablet_manager.cc:1397] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:40:40.925796 4080 tablet_bootstrap.cc:654] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: Neither blocks nor log segments found. Creating new log.
I20260805 22:40:40.926447 4080 log.cc:824] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: Log is configured to *not* fsync() on all Append() calls
I20260805 22:40:40.927441 4080 tablet_bootstrap.cc:492] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: No bootstrap required, opened a new log
I20260805 22:40:40.927520 4080 ts_tablet_manager.cc:1397] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:40:40.927572 4078 raft_consensus.cc:348] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:40.927784 4078 raft_consensus.cc:374] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:40.927824 4078 raft_consensus.cc:729] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eba07bb07fd48b1981c34fb35d35455, State: Initialized, Role: FOLLOWER
I20260805 22:40:40.927974 4078 consensus_queue.cc:260] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:40.928301 4078 ts_tablet_manager.cc:1428] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:40:40.928512 3932 heartbeater.cc:503] Master 127.19.77.190:34869 was elected leader, sending a full tablet report...
I20260805 22:40:40.929450 4080 raft_consensus.cc:348] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:40.929651 4080 raft_consensus.cc:374] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:40:40.929711 4080 raft_consensus.cc:729] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d16bca238e954f63a29b2b429044810c, State: Initialized, Role: FOLLOWER
I20260805 22:40:40.929831 4080 consensus_queue.cc:260] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:40.930126 4080 ts_tablet_manager.cc:1428] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:40:40.930168 4068 heartbeater.cc:503] Master 127.19.77.190:34869 was elected leader, sending a full tablet report...
W20260805 22:40:40.985293 3933 tablet.cc:2369] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:40:41.099771 3794 tablet.cc:2369] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:40:41.143805 4069 tablet.cc:2369] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:40:41.180094 4082 raft_consensus.cc:482] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:40:41.180402 4082 raft_consensus.cc:504] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:41.180894 4082 leader_election.cc:288] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d16bca238e954f63a29b2b429044810c (127.19.77.131:33721), 2d41dd4c3d494c8d8fcbb33763edf1a5 (127.19.77.129:42419)
I20260805 22:40:41.185016 4075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:41.181249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:59367 (local address 127.19.77.131:33721)
0805 22:40:41.181301 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:41.181303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:41.181312 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:40:41.181344 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:41.181346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:41.181356 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:41.181445 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:41.181604 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.182391 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.183988 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.184572 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.184661 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:41.184672 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:41.184892 (+ 220us) server_negotiation.cc:299] Negotiation successful
0805 22:40:41.184937 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:40:41.185017 4085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:41.181208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:59951 (local address 127.19.77.129:42419)
0805 22:40:41.181339 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:41.181341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:41.181375 (+ 34us) server_negotiation.cc:407] Connection header received
0805 22:40:41.181498 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:41.181499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:41.181531 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:41.181633 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:40:41.181781 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.182510 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.183988 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.184652 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.184725 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:41.184784 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:41.184892 (+ 108us) server_negotiation.cc:299] Negotiation successful
0805 22:40:41.184939 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260805 22:40:41.185097 3934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:41.181077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33721 (local address 127.19.77.130:59367)
0805 22:40:41.181160 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:41.181172 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:41.181224 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:41.181448 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:41.181449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:41.181451 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:41.181529 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:41.181530 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.182509 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.182510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:41.183868 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:41.183871 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.184670 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.184671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:41.184786 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:41.184791 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:40:41.184859 (+ 68us) client_negotiation.cc:240] Negotiation successful
0805 22:40:41.184914 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":38}
I20260805 22:40:41.185105 4084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:41.181125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42419 (local address 127.19.77.130:59951)
0805 22:40:41.181310 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:41.181328 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:40:41.181382 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:40:41.181655 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:40:41.181656 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:40:41.181658 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:40:41.181708 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:41.181709 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.182602 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.182603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:41.183868 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:40:41.183871 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.184730 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.184731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:40:41.184814 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:41.184817 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:40:41.184872 (+ 55us) client_negotiation.cc:240] Negotiation successful
0805 22:40:41.184914 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":6,"thread_start_us":110,"threads_started":1}
I20260805 22:40:41.185478 4021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220bbe2ebf10479d993743f2121df713" candidate_uuid: "0eba07bb07fd48b1981c34fb35d35455" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d16bca238e954f63a29b2b429044810c" is_pre_election: true
I20260805 22:40:41.185485 3745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220bbe2ebf10479d993743f2121df713" candidate_uuid: "0eba07bb07fd48b1981c34fb35d35455" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" is_pre_election: true
I20260805 22:40:41.185652 4021 raft_consensus.cc:2454] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0eba07bb07fd48b1981c34fb35d35455 in term 0.
I20260805 22:40:41.185652 3745 raft_consensus.cc:2454] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0eba07bb07fd48b1981c34fb35d35455 in term 0.
I20260805 22:40:41.185923 3818 leader_election.cc:302] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eba07bb07fd48b1981c34fb35d35455, 2d41dd4c3d494c8d8fcbb33763edf1a5; no voters:
I20260805 22:40:41.186089 4082 raft_consensus.cc:2781] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:40:41.186152 4082 raft_consensus.cc:482] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:40:41.186185 4082 raft_consensus.cc:3037] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:41.186947 4082 raft_consensus.cc:504] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:41.187116 4082 leader_election.cc:288] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [CANDIDATE]: Term 1 election: Requested vote from peers d16bca238e954f63a29b2b429044810c (127.19.77.131:33721), 2d41dd4c3d494c8d8fcbb33763edf1a5 (127.19.77.129:42419)
I20260805 22:40:41.187352 3745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220bbe2ebf10479d993743f2121df713" candidate_uuid: "0eba07bb07fd48b1981c34fb35d35455" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5"
I20260805 22:40:41.187412 4021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220bbe2ebf10479d993743f2121df713" candidate_uuid: "0eba07bb07fd48b1981c34fb35d35455" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d16bca238e954f63a29b2b429044810c"
I20260805 22:40:41.187461 3745 raft_consensus.cc:3037] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:41.187484 4021 raft_consensus.cc:3037] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:40:41.188391 4021 raft_consensus.cc:2454] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0eba07bb07fd48b1981c34fb35d35455 in term 1.
I20260805 22:40:41.188391 3745 raft_consensus.cc:2454] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0eba07bb07fd48b1981c34fb35d35455 in term 1.
I20260805 22:40:41.188655 3818 leader_election.cc:302] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eba07bb07fd48b1981c34fb35d35455, 2d41dd4c3d494c8d8fcbb33763edf1a5; no voters:
I20260805 22:40:41.188767 4082 raft_consensus.cc:2781] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:40:41.188933 4082 raft_consensus.cc:686] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 1 LEADER]: Becoming Leader. State: Replica: 0eba07bb07fd48b1981c34fb35d35455, State: Running, Role: LEADER
I20260805 22:40:41.189050 4082 consensus_queue.cc:237] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:40:41.189975 3603 catalog_manager.cc:5495] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130). New cstate: current_term: 1 leader_uuid: "0eba07bb07fd48b1981c34fb35d35455" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260805 22:40:41.203195 4076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:41.200660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60500 (local address 127.19.77.130:38347)
0805 22:40:41.200737 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:41.200740 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:41.200750 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:40:41.200801 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:41.200802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:41.200824 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:41.200905 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:40:41.201020 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.201510 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.202299 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.202499 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.202581 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:41.202782 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:40:41.202834 (+ 52us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0805 22:40:41.203014 (+ 180us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60500: token expired
Metrics: {"server-negotiator.queue_time_us":41}
W20260805 22:40:41.203297 4076 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60500: token expired
I20260805 22:40:41.209980 4072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:41.203629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58562 (local address 127.19.77.190:34869)
0805 22:40:41.203671 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:41.203673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:41.203688 (+ 15us) server_negotiation.cc:407] Connection header received
0805 22:40:41.203711 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:41.203712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:41.203728 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:41.203773 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:40:41.204293 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.204756 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.205522 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.205715 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.205789 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:41.207100 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:40:41.207101 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:40:41.207101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:40:41.207109 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:40:41.208637 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:41.209012 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:41.209013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:41.209013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:41.209073 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:40:41.209321 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:40:41.209322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:40:41.209322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:40:41.209470 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:40:41.209623 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:41.209773 (+ 150us) server_negotiation.cc:299] Negotiation successful
0805 22:40:41.209876 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:40:41.214991 4076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:41.212705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60512 (local address 127.19.77.130:38347)
0805 22:40:41.212753 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:40:41.212755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:40:41.212765 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:40:41.212824 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:40:41.212824 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:40:41.212836 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:40:41.212882 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:40:41.213012 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.213477 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.214296 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:40:41.214501 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:40:41.214563 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:40:41.214690 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:40:41.214800 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:40:41.214842 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0805 22:40:41.214892 (+ 50us) server_negotiation.cc:299] Negotiation successful
0805 22:40:41.214916 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:40:41.217633 4021 raft_consensus.cc:1261] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c [term 1 FOLLOWER]: Refusing update from remote peer 0eba07bb07fd48b1981c34fb35d35455: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:40:41.217633 3745 raft_consensus.cc:1261] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Refusing update from remote peer 0eba07bb07fd48b1981c34fb35d35455: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:40:41.218014 4086 consensus_queue.cc:1035] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:40:41.218169 4082 consensus_queue.cc:1035] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:40:41.221271 4089 mvcc.cc:205] Tried to move back new op lower bound from 7315331650424184832 to 7315331650311012352. Current Snapshot: MvccSnapshot[applied={T|T < 7315331650424184832}]
I20260805 22:40:41.221498 4088 mvcc.cc:205] Tried to move back new op lower bound from 7315331650424184832 to 7315331650311012352. Current Snapshot: MvccSnapshot[applied={T|T < 7315331650424184832 or (T in {7315331650424184832})}]
I20260805 22:40:41.224408 3602 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:40:41.224522 3602 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:40:41.225365 3602 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Sending DeleteTablet for 3 replicas of tablet 220bbe2ebf10479d993743f2121df713
I20260805 22:40:41.225695 3714 tablet_service.cc:1514] Processing DeleteTablet for tablet 220bbe2ebf10479d993743f2121df713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:41 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:57518
I20260805 22:40:41.225715 3866 tablet_service.cc:1514] Processing DeleteTablet for tablet 220bbe2ebf10479d993743f2121df713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:41 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:60494
I20260805 22:40:41.225778 4001 tablet_service.cc:1514] Processing DeleteTablet for tablet 220bbe2ebf10479d993743f2121df713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:40:41 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:58054
I20260805 22:40:41.225951 4098 tablet_replica.cc:330] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: stopping tablet replica
I20260805 22:40:41.226014 4098 raft_consensus.cc:2229] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:40:41.226063 4098 raft_consensus.cc:2258] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:41.226104 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 3642
I20260805 22:40:41.228368 4100 tablet_replica.cc:330] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: stopping tablet replica
I20260805 22:40:41.228578 4100 raft_consensus.cc:2229] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:40:41.228754 4100 raft_consensus.cc:2258] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:41.229089 4099 tablet_replica.cc:330] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: stopping tablet replica
I20260805 22:40:41.229278 4099 raft_consensus.cc:2229] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:40:41.229421 4100 ts_tablet_manager.cc:1905] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:41.229441 4099 raft_consensus.cc:2258] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:40:41.229995 4099 ts_tablet_manager.cc:1905] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:40:41.231701 4100 ts_tablet_manager.cc:1918] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:40:41.231799 4100 log.cc:1196] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/220bbe2ebf10479d993743f2121df713
I20260805 22:40:41.232124 4099 ts_tablet_manager.cc:1918] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:40:41.232144 4100 ts_tablet_manager.cc:1939] T 220bbe2ebf10479d993743f2121df713 P d16bca238e954f63a29b2b429044810c: Deleting consensus metadata
I20260805 22:40:41.232299 4099 log.cc:1196] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/220bbe2ebf10479d993743f2121df713
I20260805 22:40:41.232640 4099 ts_tablet_manager.cc:1939] T 220bbe2ebf10479d993743f2121df713 P 0eba07bb07fd48b1981c34fb35d35455: Deleting consensus metadata
I20260805 22:40:41.232648 3588 catalog_manager.cc:4841] TS d16bca238e954f63a29b2b429044810c (127.19.77.131:33721): tablet 220bbe2ebf10479d993743f2121df713 (table test-table [id=81ee0d47f1644c4fa723a8f1f0ca3087]) successfully deleted
I20260805 22:40:41.233263 3588 catalog_manager.cc:4841] TS 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347): tablet 220bbe2ebf10479d993743f2121df713 (table test-table [id=81ee0d47f1644c4fa723a8f1f0ca3087]) successfully deleted
W20260805 22:40:41.234043 3587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:42419 (error 108)
I20260805 22:40:41.234596 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 3798
I20260805 22:40:41.234709 4074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:40:41.234559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:42419 (local address 127.0.0.1:57520)
0805 22:40:41.234627 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0805 22:40:41.234670 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:42419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260805 22:40:41.236174 3587 catalog_manager.cc:4584] TS 2d41dd4c3d494c8d8fcbb33763edf1a5 (127.19.77.129:42419): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 220bbe2ebf10479d993743f2121df713: Network error: Client connection negotiation failed: client connection to 127.19.77.129:42419: connect: Connection refused (error 111)
I20260805 22:40:41.243923 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 3935
I20260805 22:40:41.250169 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 3570
I20260805 22:41:01.257558 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34869
--webserver_interface=127.19.77.190
--webserver_port=32871
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:34869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:01.347994 4102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:01.348232 4102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:01.348256 4102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:01.349483 4102 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 22:41:01.349545 4102 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 22:41:01.349558 4102 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 22:41:01.349570 4102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:01.349584 4102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:01.349597 4102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:01.349647 4102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:01.349666 4102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:01.351397 4102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:34869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=32871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:01.351696 4102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:01.351965 4102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:01.357767 4107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:01.357777 4108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:01.357767 4110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:01.357792 4102 server_base.cc:1034] running on GCE node
I20260805 22:41:01.358264 4102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:01.358624 4102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:01.359817 4102 hybrid_clock.cc:648] HybridClock initialized: now 1785969661359809 us; error 37 us; skew 500 ppm
Aug 05 22:41:01 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:01.366494 4102 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:01.367051 4102 webserver.cc:460] Webserver started at http://127.19.77.190:32871/ using document root <none> and password file <none>
I20260805 22:41:01.367339 4102 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:01.367413 4102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:01.368944 4102 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:01.369688 4117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:01.369890 4102 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:01.370013 4102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "35a3653543ea4cf1a561283e23fd55a4"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "8a7c22c76906b84d2b1e513ebdf20331"
server_key_iv: "672aaa579fb8e6cd3c88ae6c2abb3412"
server_key_version: "encryptionkey@0"
I20260805 22:41:01.370417 4102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:01.397254 4102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:01.399799 4102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:01.399979 4102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:01.404433 4102 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:34869
I20260805 22:41:01.404471 4170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:34869 every 8 connection(s)
I20260805 22:41:01.404873 4102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:01.406301 4171 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:41:01.407109 4171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Bootstrap starting.
I20260805 22:41:01.414599 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 4102
I20260805 22:41:01.415002 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:42419
--local_ip_for_outbound_sockets=127.19.77.129
--tserver_master_addrs=127.19.77.190:34869
--webserver_port=37979
--webserver_interface=127.19.77.129
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:41:01.417634 4171 log.cc:824] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:01.420809 4171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:41:01.421175 4171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Bootstrap complete.
I20260805 22:41:01.423682 4171 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:41:01.423938 4171 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35a3653543ea4cf1a561283e23fd55a4, State: Initialized, Role: FOLLOWER
I20260805 22:41:01.424113 4171 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:41:01.424175 4171 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:01.424227 4171 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:01.424275 4171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 2 FOLLOWER]: Advancing to term 3
I20260805 22:41:01.425333 4171 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:41:01.425421 4171 leader_election.cc:302] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35a3653543ea4cf1a561283e23fd55a4; no voters:
I20260805 22:41:01.425661 4171 leader_election.cc:288] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260805 22:41:01.425700 4175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260805 22:41:01.425822 4175 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [term 3 LEADER]: Becoming Leader. State: Replica: 35a3653543ea4cf1a561283e23fd55a4, State: Running, Role: LEADER
I20260805 22:41:01.425910 4175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } }
I20260805 22:41:01.425945 4171 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:01.426219 4175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "35a3653543ea4cf1a561283e23fd55a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } } }
I20260805 22:41:01.426388 4175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:01.426613 4175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35a3653543ea4cf1a561283e23fd55a4. Latest consensus state: current_term: 3 leader_uuid: "35a3653543ea4cf1a561283e23fd55a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35a3653543ea4cf1a561283e23fd55a4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34869 } } }
I20260805 22:41:01.426692 4175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:01.427080 4182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:01.427968 4182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:01.428100 4182 catalog_manager.cc:1259] Loaded cluster ID: c64a6ff49b8d46e1a2cfc70c15a1ff22
I20260805 22:41:01.428341 4182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:01.429145 4182 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:01.429338 4182 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Loaded TSK: 0
I20260805 22:41:01.429394 4182 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 35a3653543ea4cf1a561283e23fd55a4: Loaded TSK: 1
F20260805 22:41:01.429622 4182 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4c483579ad google::LogMessage::Fail() at ??:0
@ 0x7f4c4835a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f4c483574de google::LogMessage::Flush() at ??:0
@ 0x7f4c48358a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4c4aac4104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f4c4aac1d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f4c502b11cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f4c502b148e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f4c502b1594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f4c50277c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f4c50281ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f4c4a2250d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4c4a21a954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4c4b07e6db start_thread at ??:0
@ 0x7f4c46e5561f clone at ??:0
W20260805 22:41:01.524878 4173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:01.525398 4173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:01.525530 4173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:01.527397 4173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:01.527470 4173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:01.527519 4173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:41:01.529263 4173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:42419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=37979
--tserver_master_addrs=127.19.77.190:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:01.529573 4173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:01.529850 4173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:41:01.536409 4173 server_base.cc:1034] running on GCE node
W20260805 22:41:01.536432 4213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:01.536537 4214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:01.536405 4216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:01.536983 4173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:01.537319 4173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:01.538511 4173 hybrid_clock.cc:648] HybridClock initialized: now 1785969661538493 us; error 39 us; skew 500 ppm
Aug 05 22:41:01 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:01.542043 4173 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:41:01.542709 4173 webserver.cc:460] Webserver started at http://127.19.77.129:37979/ using document root <none> and password file <none>
I20260805 22:41:01.542991 4173 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:01.543063 4173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:01.545064 4173 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:41:01.545989 4223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:01.546221 4173 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:01.546319 4173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "ccbc207367461bddc7482239e4595128"
server_key_iv: "6a15151c90fb1bff2ef2fa2f82140fe4"
server_key_version: "encryptionkey@0"
I20260805 22:41:01.546802 4173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:01.580709 4173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:01.583545 4173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:01.583761 4173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:01.584082 4173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:01.584635 4230 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260805 22:41:01.586284 4173 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 22:41:01.586359 4173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260805 22:41:01.586398 4173 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260805 22:41:01.587395 4173 ts_tablet_manager.cc:610] Registered 1 tablets
I20260805 22:41:01.587446 4173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:01.587528 4230 tablet_bootstrap.cc:492] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Bootstrap starting.
I20260805 22:41:01.595355 4173 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:42419
I20260805 22:41:01.595662 4338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:42419 every 8 connection(s)
I20260805 22:41:01.595899 4173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:41:01.600416 4230 log.cc:824] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:01.602792 4230 tablet_bootstrap.cc:492] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:41:01.602946 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 4173
I20260805 22:41:01.603245 4230 tablet_bootstrap.cc:492] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Bootstrap complete.
I20260805 22:41:01.603287 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:38347
--local_ip_for_outbound_sockets=127.19.77.130
--tserver_master_addrs=127.19.77.190:34869
--webserver_port=39423
--webserver_interface=127.19.77.130
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:41:01.604645 4230 ts_tablet_manager.cc:1397] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.012s
I20260805 22:41:01.605993 4230 raft_consensus.cc:348] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:41:01.606277 4230 raft_consensus.cc:729] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d41dd4c3d494c8d8fcbb33763edf1a5, State: Initialized, Role: FOLLOWER
I20260805 22:41:01.606447 4230 consensus_queue.cc:260] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:41:01.606755 4230 ts_tablet_manager.cc:1428] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260805 22:41:01.686335 4341 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:01.596646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:55451)
0805 22:41:01.596868 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:01.596921 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:01.597691 (+ 770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:01.686098 (+ 88407us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":102,"threads_started":1}
W20260805 22:41:01.686651 4339 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:34869 (0 consecutive failures): Network error: Failed to ping master at 127.19.77.190:34869: Client connection negotiation failed: client connection to 127.19.77.190:34869: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 22:41:01.687017 4341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:01.686899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:33873)
0805 22:41:01.686951 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:01.686996 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260805 22:41:01.687402 4341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:01.687317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:55287)
0805 22:41:01.687362 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:01.687387 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260805 22:41:01.687527 4339 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:41:01.717697 4343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:01.717942 4343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:01.717970 4343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:01.719245 4343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:01.719295 4343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:01.719326 4343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:41:01.720933 4343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:38347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=39423
--tserver_master_addrs=127.19.77.190:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:01.721161 4343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:01.721375 4343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:01.726836 4349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:01.726836 4352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:01.726950 4350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:01.727309 4343 server_base.cc:1034] running on GCE node
I20260805 22:41:01.727594 4343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:01.727885 4343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:01.729022 4343 hybrid_clock.cc:648] HybridClock initialized: now 1785969661728996 us; error 50 us; skew 500 ppm
Aug 05 22:41:01 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:01.733076 4343 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:41:01.733747 4343 webserver.cc:460] Webserver started at http://127.19.77.130:39423/ using document root <none> and password file <none>
I20260805 22:41:01.734071 4343 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:01.734143 4343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:01.736100 4343 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260805 22:41:01.736933 4359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:01.737185 4343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:01.737293 4343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "0eba07bb07fd48b1981c34fb35d35455"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "893cc7da923c8a83a05b238351209b8c"
server_key_iv: "3b3c304d85bfc17999cbddad78c3c68c"
server_key_version: "encryptionkey@0"
I20260805 22:41:01.737778 4343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:01.755507 4343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:01.757859 4343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:01.758085 4343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:01.758376 4343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:01.758744 4343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:01.758781 4343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:01.758805 4343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:01.758818 4343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:01.765702 4343 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:38347
I20260805 22:41:01.765760 4473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:38347 every 8 connection(s)
I20260805 22:41:01.766131 4343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:41:01.767297 4476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:01.766816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:56993)
0805 22:41:01.766994 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:01.767076 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
W20260805 22:41:01.767722 4474 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:34869 (0 consecutive failures): Network error: Failed to ping master at 127.19.77.190:34869: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
I20260805 22:41:01.768002 4476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:01.767913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:60567)
0805 22:41:01.767955 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:01.767983 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260805 22:41:01.768277 4476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:01.768207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:55823)
0805 22:41:01.768243 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:01.768264 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260805 22:41:01.768389 4474 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:41:01.772478 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 4343
I20260805 22:41:01.772815 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:33721
--local_ip_for_outbound_sockets=127.19.77.131
--tserver_master_addrs=127.19.77.190:34869
--webserver_port=38603
--webserver_interface=127.19.77.131
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:01.860800 4477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:01.861025 4477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:01.861052 4477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:01.862185 4477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:01.862226 4477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:01.862252 4477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:41:01.863798 4477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:33721
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=38603
--tserver_master_addrs=127.19.77.190:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:01.864014 4477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:01.864205 4477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:01.869374 4485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:01.869522 4477 server_base.cc:1034] running on GCE node
W20260805 22:41:01.869414 4483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:01.869386 4482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:01.869871 4477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:01.870126 4477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:01.871333 4477 hybrid_clock.cc:648] HybridClock initialized: now 1785969661871311 us; error 37 us; skew 500 ppm
Aug 05 22:41:01 dist-test-slave-chsk krb5kdc[3013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:01.873984 4477 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:41:01.874483 4477 webserver.cc:460] Webserver started at http://127.19.77.131:38603/ using document root <none> and password file <none>
I20260805 22:41:01.874733 4477 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:01.874805 4477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:01.876323 4477 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:01.877020 4492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:01.877256 4477 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:01.877374 4477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "d16bca238e954f63a29b2b429044810c"
format_stamp: "Formatted at 2026-08-05 22:40:19 on dist-test-slave-chsk"
server_key: "58dacf796d445cb7c854d956c3a6201e"
server_key_iv: "10dcebd8675a80bd4aaf047b847fb287"
server_key_version: "encryptionkey@0"
I20260805 22:41:01.877753 4477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:01.891896 4477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:01.893992 4477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:01.894194 4477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:01.894452 4477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:01.894786 4477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:01.894846 4477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:01.894888 4477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:01.894925 4477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:01.901352 4477 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:33721
I20260805 22:41:01.901400 4607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:33721 every 8 connection(s)
I20260805 22:41:01.901791 4477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:41:01.902944 4610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:01.902549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:47581)
0805 22:41:01.902719 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:01.902800 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
W20260805 22:41:01.903416 4608 heartbeater.cc:644] Failed to heartbeat to 127.19.77.190:34869 (0 consecutive failures): Network error: Failed to ping master at 127.19.77.190:34869: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
I20260805 22:41:01.903705 4610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:01.903613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:35751)
0805 22:41:01.903659 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:01.903687 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260805 22:41:01.903981 4610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:01.903911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:44249)
0805 22:41:01.903947 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:01.903968 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260805 22:41:01.904094 4608 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:41:01.909164 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 4477
I20260805 22:41:02.688210 4612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:02.687920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:52533)
0805 22:41:02.688089 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:02.688134 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
I20260805 22:41:02.769048 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:02.768788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:58493)
0805 22:41:02.768943 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:02.768989 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":81,"threads_started":1}
I20260805 22:41:02.828991 4614 raft_consensus.cc:482] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:02.829181 4614 raft_consensus.cc:504] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:41:02.829547 4614 leader_election.cc:288] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347), d16bca238e954f63a29b2b429044810c (127.19.77.131:33721)
Aug 05 22:41:02 dist-test-slave-chsk krb5kdc[3013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.130@KRBTEST.COM
Aug 05 22:41:02 dist-test-slave-chsk krb5kdc[3013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.131@KRBTEST.COM
I20260805 22:41:02.841439 4612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:02.829787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:38347 (local address 127.19.77.129:54859)
0805 22:41:02.829855 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:02.829872 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:02.829958 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:02.830909 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:02.830911 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:02.831372 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:02.831575 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:02.831581 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:02.832715 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:02.832722 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:02.833679 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:02.833682 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:02.834285 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:02.834286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:02.834411 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:02.835079 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:02.835084 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:02.836631 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:02.838976 (+ 2345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:02.838987 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:02.838990 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:02.839523 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:02.839883 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:02.839884 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:02.839885 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:02.840100 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:02.840724 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:02.840733 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:02.840916 (+ 183us) client_negotiation.cc:769] Sending connection context
0805 22:41:02.841050 (+ 134us) client_negotiation.cc:240] Negotiation successful
0805 22:41:02.841347 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":148}
I20260805 22:41:02.841467 4616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:02.829955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:54859 (local address 127.19.77.130:38347)
0805 22:41:02.830138 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:02.830152 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:02.830191 (+ 39us) server_negotiation.cc:407] Connection header received
0805 22:41:02.830662 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:02.830664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:02.830710 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:02.830874 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:02.831706 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:02.832596 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:02.833770 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:02.834189 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:02.834318 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:02.836780 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:02.836785 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:02.836785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:02.836800 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:02.838860 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:02.839641 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:02.839644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:02.839645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:02.839780 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:02.840241 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:02.840242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:02.840243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:02.840640 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:02.840739 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:02.841177 (+ 438us) server_negotiation.cc:299] Negotiation successful
0805 22:41:02.841320 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
I20260805 22:41:02.841466 4617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:02.830071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:55277 (local address 127.19.77.131:33721)
0805 22:41:02.830234 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:02.830245 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:02.830272 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:41:02.830696 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:02.830699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:02.830748 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:02.830901 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:02.831706 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:02.832610 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:02.833768 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:02.834188 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:02.834315 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:02.837081 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:02.837090 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:02.837090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:02.837101 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:02.838896 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:02.839640 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:02.839644 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:02.839645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:02.839781 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:02.840256 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:02.840257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:02.840257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:02.840640 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:02.840739 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:02.841154 (+ 415us) server_negotiation.cc:299] Negotiation successful
0805 22:41:02.841322 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260805 22:41:02.841835 4615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:02.829954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33721 (local address 127.19.77.129:55277)
0805 22:41:02.830088 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:02.830101 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:02.830162 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:02.830909 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:02.830912 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:02.831370 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:02.831574 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:02.831581 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:02.832726 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:02.832727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:02.833679 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:02.833683 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:02.834287 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:02.834288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:02.834410 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:02.835008 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:02.835016 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:02.836961 (+ 1945us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:02.838990 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:02.838992 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:02.838992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:02.839523 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:02.839883 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:02.839884 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:02.839885 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:02.840100 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:02.840724 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:02.840733 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:02.840916 (+ 183us) client_negotiation.cc:769] Sending connection context
0805 22:41:02.841050 (+ 134us) client_negotiation.cc:240] Negotiation successful
0805 22:41:02.841699 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":98,"thread_start_us":77,"threads_started":1}
W20260805 22:41:02.842660 4225 leader_election.cc:341] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347): Not found: Tablet not found: 220bbe2ebf10479d993743f2121df713
W20260805 22:41:02.842739 4225 leader_election.cc:341] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d16bca238e954f63a29b2b429044810c (127.19.77.131:33721): Not found: Tablet not found: 220bbe2ebf10479d993743f2121df713
I20260805 22:41:02.842757 4225 leader_election.cc:302] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d41dd4c3d494c8d8fcbb33763edf1a5; no voters: 0eba07bb07fd48b1981c34fb35d35455, d16bca238e954f63a29b2b429044810c
I20260805 22:41:02.842859 4614 raft_consensus.cc:2726] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:41:02.904747 4618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:02.904482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:54827)
0805 22:41:02.904636 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:02.904701 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":71,"threads_started":1}
I20260805 22:41:03.689082 4619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:03.688828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:36075)
0805 22:41:03.688982 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:03.689029 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":69,"threads_started":1}
I20260805 22:41:03.769896 4620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:03.769641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:44747)
0805 22:41:03.769803 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:03.769845 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":67,"threads_started":1}
I20260805 22:41:03.905608 4621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:03.905317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:36851)
0805 22:41:03.905486 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:03.905538 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":73,"threads_started":1}
I20260805 22:41:04.690068 4622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:04.689811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:42181)
0805 22:41:04.689967 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:04.690015 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":76,"threads_started":1}
I20260805 22:41:04.770699 4623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:04.770451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:38133)
0805 22:41:04.770610 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:04.770648 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
I20260805 22:41:04.906386 4624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:04.906151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:36545)
0805 22:41:04.906291 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:04.906339 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260805 22:41:04.942168 4625 raft_consensus.cc:482] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:04.942299 4625 raft_consensus.cc:504] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:41:04.942485 4625 leader_election.cc:288] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347), d16bca238e954f63a29b2b429044810c (127.19.77.131:33721)
W20260805 22:41:04.942900 4225 leader_election.cc:341] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347): Not found: Tablet not found: 220bbe2ebf10479d993743f2121df713
W20260805 22:41:04.942974 4225 leader_election.cc:341] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d16bca238e954f63a29b2b429044810c (127.19.77.131:33721): Not found: Tablet not found: 220bbe2ebf10479d993743f2121df713
I20260805 22:41:04.942991 4225 leader_election.cc:302] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d41dd4c3d494c8d8fcbb33763edf1a5; no voters: 0eba07bb07fd48b1981c34fb35d35455, d16bca238e954f63a29b2b429044810c
I20260805 22:41:04.943070 4625 raft_consensus.cc:2726] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:41:05.690961 4626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:05.690674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:35693)
0805 22:41:05.690858 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:05.690909 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":89,"threads_started":1}
I20260805 22:41:05.771587 4627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:05.771348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:46601)
0805 22:41:05.771502 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:05.771539 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
I20260805 22:41:05.907262 4628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:05.906979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:51369)
0805 22:41:05.907166 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:05.907214 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":86,"threads_started":1}
I20260805 22:41:06.691840 4629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:06.691562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:45273)
0805 22:41:06.691739 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:06.691789 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":67,"threads_started":1}
I20260805 22:41:06.772310 4630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:06.772081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:43407)
0805 22:41:06.772218 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:06.772259 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260805 22:41:06.908234 4631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:06.907946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:40351)
0805 22:41:06.908136 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:06.908183 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":89,"threads_started":1}
I20260805 22:41:06.954329 4632 raft_consensus.cc:482] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:06.954443 4632 raft_consensus.cc:504] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:41:06.954689 4632 leader_election.cc:288] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347), d16bca238e954f63a29b2b429044810c (127.19.77.131:33721)
W20260805 22:41:06.955201 4225 leader_election.cc:341] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347): Not found: Tablet not found: 220bbe2ebf10479d993743f2121df713
W20260805 22:41:06.955309 4225 leader_election.cc:341] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d16bca238e954f63a29b2b429044810c (127.19.77.131:33721): Not found: Tablet not found: 220bbe2ebf10479d993743f2121df713
I20260805 22:41:06.955343 4225 leader_election.cc:302] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d41dd4c3d494c8d8fcbb33763edf1a5; no voters: 0eba07bb07fd48b1981c34fb35d35455, d16bca238e954f63a29b2b429044810c
I20260805 22:41:06.955444 4632 raft_consensus.cc:2726] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:41:07.692675 4633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:07.692416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:53039)
0805 22:41:07.692567 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:07.692615 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":73,"threads_started":1}
I20260805 22:41:07.773134 4634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:07.772841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:47445)
0805 22:41:07.773035 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:07.773084 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":131,"threads_started":1}
I20260805 22:41:07.909222 4635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:07.908934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:34355)
0805 22:41:07.909123 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:07.909173 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":87,"threads_started":1}
I20260805 22:41:08.693446 4636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:08.693206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:50859)
0805 22:41:08.693351 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:08.693394 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
I20260805 22:41:08.773924 4637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:08.773704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:58289)
0805 22:41:08.773839 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:08.773876 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260805 22:41:08.910158 4638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:08.909868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:38743)
0805 22:41:08.910048 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:08.910095 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":87,"threads_started":1}
I20260805 22:41:09.130498 4639 raft_consensus.cc:482] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:09.130620 4639 raft_consensus.cc:504] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:41:09.130823 4639 leader_election.cc:288] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347), d16bca238e954f63a29b2b429044810c (127.19.77.131:33721)
W20260805 22:41:09.131408 4225 leader_election.cc:341] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d16bca238e954f63a29b2b429044810c (127.19.77.131:33721): Not found: Tablet not found: 220bbe2ebf10479d993743f2121df713
W20260805 22:41:09.131512 4225 leader_election.cc:341] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347): Not found: Tablet not found: 220bbe2ebf10479d993743f2121df713
I20260805 22:41:09.131547 4225 leader_election.cc:302] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d41dd4c3d494c8d8fcbb33763edf1a5; no voters: 0eba07bb07fd48b1981c34fb35d35455, d16bca238e954f63a29b2b429044810c
I20260805 22:41:09.131646 4639 raft_consensus.cc:2726] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:41:09.694360 4640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:09.694072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:41565)
0805 22:41:09.694257 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:09.694307 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":85,"threads_started":1}
I20260805 22:41:09.774748 4641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:09.774490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:33139)
0805 22:41:09.774649 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:09.774698 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":69,"threads_started":1}
I20260805 22:41:09.911110 4642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:09.910809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:47611)
0805 22:41:09.910982 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:09.911046 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":105,"threads_started":1}
I20260805 22:41:10.695400 4643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:10.694990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:54231)
0805 22:41:10.695306 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:10.695351 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":73,"threads_started":1}
I20260805 22:41:10.775565 4644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:10.775352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:43075)
0805 22:41:10.775479 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:10.775517 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260805 22:41:10.911999 4645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:10.911701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:53421)
0805 22:41:10.911886 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:10.911935 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":87,"threads_started":1}
I20260805 22:41:11.696254 4646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:11.695976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:44889)
0805 22:41:11.696153 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:11.696202 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":73,"threads_started":1}
I20260805 22:41:11.776328 4647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:11.776092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:39085)
0805 22:41:11.776238 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:11.776280 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":66,"threads_started":1}
I20260805 22:41:11.855942 4648 raft_consensus.cc:482] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:11.856103 4648 raft_consensus.cc:504] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eba07bb07fd48b1981c34fb35d35455" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 38347 } } peers { permanent_uuid: "d16bca238e954f63a29b2b429044810c" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33721 } } peers { permanent_uuid: "2d41dd4c3d494c8d8fcbb33763edf1a5" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 42419 } }
I20260805 22:41:11.856315 4648 leader_election.cc:288] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347), d16bca238e954f63a29b2b429044810c (127.19.77.131:33721)
W20260805 22:41:11.856766 4225 leader_election.cc:341] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d16bca238e954f63a29b2b429044810c (127.19.77.131:33721): Not found: Tablet not found: 220bbe2ebf10479d993743f2121df713
W20260805 22:41:11.856854 4225 leader_election.cc:341] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0eba07bb07fd48b1981c34fb35d35455 (127.19.77.130:38347): Not found: Tablet not found: 220bbe2ebf10479d993743f2121df713
I20260805 22:41:11.856889 4225 leader_election.cc:302] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d41dd4c3d494c8d8fcbb33763edf1a5; no voters: 0eba07bb07fd48b1981c34fb35d35455, d16bca238e954f63a29b2b429044810c
I20260805 22:41:11.856983 4648 raft_consensus.cc:2726] T 220bbe2ebf10479d993743f2121df713 P 2d41dd4c3d494c8d8fcbb33763edf1a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:41:11.912765 4649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:11.912491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:60955)
0805 22:41:11.912669 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:11.912714 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":89,"threads_started":1}
I20260805 22:41:12.697115 4650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:12.696842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:43325)
0805 22:41:12.697011 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:12.697061 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":76,"threads_started":1}
I20260805 22:41:12.777165 4651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:12.776882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:44685)
0805 22:41:12.777050 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:12.777098 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":73,"threads_started":1}
I20260805 22:41:12.913524 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:12.913298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:53049)
0805 22:41:12.913433 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:12.913474 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":67,"threads_started":1}
I20260805 22:41:13.697933 4653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:13.697657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:35067)
0805 22:41:13.697830 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:13.697880 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":68,"threads_started":1}
I20260805 22:41:13.777966 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:13.777708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:43195)
0805 22:41:13.777869 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:13.777915 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260805 22:41:13.914366 4655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:13.914115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:49569)
0805 22:41:13.914276 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:13.914317 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":88,"threads_started":1}
I20260805 22:41:14.698726 4656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:14.698475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:32789)
0805 22:41:14.698638 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:14.698677 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":68,"threads_started":1}
I20260805 22:41:14.778822 4657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:14.778537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:58401)
0805 22:41:14.778726 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:14.778773 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":94,"threads_started":1}
I20260805 22:41:14.915321 4658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:14.915002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:51523)
0805 22:41:14.915219 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:14.915273 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":69,"threads_started":1}
I20260805 22:41:15.699659 4659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:15.699391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:42333)
0805 22:41:15.699561 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:15.699605 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":92,"threads_started":1}
I20260805 22:41:15.779704 4660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:15.779419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:42421)
0805 22:41:15.779605 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:15.779654 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":73,"threads_started":1}
I20260805 22:41:15.916173 4661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:15.915893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:48011)
0805 22:41:15.916073 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:15.916123 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":75,"threads_started":1}
I20260805 22:41:16.700451 4662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:16.700234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.129:37605)
0805 22:41:16.700365 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:16.700405 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260805 22:41:16.780684 4663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:16.780398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.130:46423)
0805 22:41:16.780554 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:16.780604 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":71,"threads_started":1}
I20260805 22:41:16.912375 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 4173
I20260805 22:41:16.917104 4664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:16.916855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34869 (local address 127.19.77.131:36727)
0805 22:41:16.917017 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:16.917056 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.190:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260805 22:41:16.919301 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 4343
I20260805 22:41:16.925781 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 4477
2026-08-05T22:41:16Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58829 ms)
[----------] 30 tests from SecurityITest (248267 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:16 dist-test-slave-chsk krb5kdc[4667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:16 dist-test-slave-chsk krb5kdc[4667](info): set up 2 sockets
Aug 05 22:41:16 dist-test-slave-chsk krb5kdc[4667](info): commencing operation
krb5kdc: starting...
W20260805 22:41:17.990940 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:18 dist-test-slave-chsk krb5kdc[4667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:18.126601 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:40679
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:40679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:18.214962 4680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:18.215240 4680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:18.215272 4680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:18.216533 4680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:18.216581 4680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:18.216596 4680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:18.216609 4680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:18.216622 4680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:18.218225 4680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:40679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:40679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:18.218465 4680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:18.218670 4680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:18.224887 4685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:18.224887 4688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:18.224927 4686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:18.224957 4680 server_base.cc:1034] running on GCE node
I20260805 22:41:18.225613 4680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:18.225960 4680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:18.227131 4680 hybrid_clock.cc:648] HybridClock initialized: now 1785969678227112 us; error 47 us; skew 500 ppm
Aug 05 22:41:18 dist-test-slave-chsk krb5kdc[4667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969678, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:18.230319 4680 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:18.230903 4680 webserver.cc:460] Webserver started at http://127.19.77.190:40925/ using document root <none> and password file <none>
I20260805 22:41:18.231226 4680 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:18.231282 4680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:18.231460 4680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:18.232640 4680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "103fd403185242b68aae81e2358e4cb1"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "1cddad6de3f512060c69684aaf9e5e14"
server_key_iv: "241d808b8d5778fb78841bd9d7c7371c"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.233045 4680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "103fd403185242b68aae81e2358e4cb1"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "1cddad6de3f512060c69684aaf9e5e14"
server_key_iv: "241d808b8d5778fb78841bd9d7c7371c"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.234557 4680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:18.235496 4695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:18.235713 4680 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:18.235795 4680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "103fd403185242b68aae81e2358e4cb1"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "1cddad6de3f512060c69684aaf9e5e14"
server_key_iv: "241d808b8d5778fb78841bd9d7c7371c"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.235898 4680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:18.248160 4680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:18.250857 4680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:18.250998 4680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:18.255801 4680 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:40679
I20260805 22:41:18.255911 4749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:40679 every 8 connection(s)
I20260805 22:41:18.256306 4680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:18.257333 4750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:18.260108 4750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1: Bootstrap starting.
I20260805 22:41:18.260814 4750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:18.261170 4750 log.cc:824] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:18.262421 4750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1: No bootstrap required, opened a new log
I20260805 22:41:18.263295 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 4680
I20260805 22:41:18.263393 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:18.263602 19766 external_mini_cluster.cc:1428] Setting key 36f78747c9df382c2643426085b4743e
I20260805 22:41:18.264796 4750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103fd403185242b68aae81e2358e4cb1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40679 } }
I20260805 22:41:18.264992 4750 raft_consensus.cc:374] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:18.265036 4750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 103fd403185242b68aae81e2358e4cb1, State: Initialized, Role: FOLLOWER
I20260805 22:41:18.265182 4750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103fd403185242b68aae81e2358e4cb1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40679 } }
I20260805 22:41:18.265318 4750 raft_consensus.cc:388] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:18.265394 4750 raft_consensus.cc:482] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:18.265468 4750 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:18.266273 4750 raft_consensus.cc:504] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103fd403185242b68aae81e2358e4cb1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40679 } }
I20260805 22:41:18.266373 4750 leader_election.cc:302] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 103fd403185242b68aae81e2358e4cb1; no voters:
I20260805 22:41:18.266593 4750 leader_election.cc:288] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:18.266654 4755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:18.266875 4755 raft_consensus.cc:686] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [term 1 LEADER]: Becoming Leader. State: Replica: 103fd403185242b68aae81e2358e4cb1, State: Running, Role: LEADER
I20260805 22:41:18.266896 4750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:18.267022 4755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103fd403185242b68aae81e2358e4cb1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40679 } }
I20260805 22:41:18.267625 4756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "103fd403185242b68aae81e2358e4cb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103fd403185242b68aae81e2358e4cb1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40679 } } }
I20260805 22:41:18.267737 4756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:18.268389 4761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:18.268935 4761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:18.269593 4757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 103fd403185242b68aae81e2358e4cb1. Latest consensus state: current_term: 1 leader_uuid: "103fd403185242b68aae81e2358e4cb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103fd403185242b68aae81e2358e4cb1" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40679 } } }
I20260805 22:41:18.269866 4757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:18.271265 4761 catalog_manager.cc:1347] Generated new cluster ID: d77cbef382534ac1a9714b98607b8f8c
I20260805 22:41:18.271324 4761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:41:18 dist-test-slave-chsk krb5kdc[4667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:18.276188 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.264211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41256 (local address 127.19.77.190:40679)
0805 22:41:18.264445 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.264453 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.264482 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:41:18.264765 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.264772 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.264824 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.265031 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:18.265874 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.267171 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.268396 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.269045 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.269166 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.272314 (+ 3148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:18.272319 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:18.272323 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:18.272338 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:18.274245 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:18.274684 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:18.274687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:18.274688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:18.274819 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:18.275059 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:18.275060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:18.275060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:18.275404 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:18.275603 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.275720 (+ 117us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.275878 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":118,"threads_started":1}
I20260805 22:41:18.298316 4761 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:18.299127 4761 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:18.306440 4761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1: Generated new TSK 0
I20260805 22:41:18.306699 4761 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:41:18.344347 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40679
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:18.433501 4777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:18.433748 4777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:18.433776 4777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:18.435099 4777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:18.435233 4777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:18.435273 4777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:41:18.436921 4777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:18.437165 4777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:18.437381 4777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:18.443068 4783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:18.443061 4782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:18.443377 4777 server_base.cc:1034] running on GCE node
W20260805 22:41:18.443068 4785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:18.443734 4777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:18.444097 4777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:18.445300 4777 hybrid_clock.cc:648] HybridClock initialized: now 1785969678445286 us; error 35 us; skew 500 ppm
Aug 05 22:41:18 dist-test-slave-chsk krb5kdc[4667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969678, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:18.448297 4777 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:41:18.448838 4777 webserver.cc:460] Webserver started at http://127.19.77.129:33019/ using document root <none> and password file <none>
I20260805 22:41:18.449101 4777 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:18.449152 4777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:18.449301 4777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:18.450533 4777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "d76af72d27694b218f1e7b1adaa57b8e"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "a198eceded8155195db23f591e93f17f"
server_key_iv: "237334c1e405f8767b6bf0320c109c42"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.450932 4777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "d76af72d27694b218f1e7b1adaa57b8e"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "a198eceded8155195db23f591e93f17f"
server_key_iv: "237334c1e405f8767b6bf0320c109c42"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.452800 4777 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260805 22:41:18.453768 4792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:18.454021 4777 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:18.454317 4777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "d76af72d27694b218f1e7b1adaa57b8e"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "a198eceded8155195db23f591e93f17f"
server_key_iv: "237334c1e405f8767b6bf0320c109c42"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.454437 4777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:18.510288 4777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:18.513116 4777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:18.513332 4777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:18.513633 4777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:18.513991 4777 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:18.514057 4777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:18.514096 4777 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:18.514128 4777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:18.521185 4777 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:39591
I20260805 22:41:18.521234 4909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:39591 every 8 connection(s)
I20260805 22:41:18.521631 4777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:41:18.521963 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 4777
I20260805 22:41:18.522087 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:41:18.522347 19766 external_mini_cluster.cc:1428] Setting key 8bb2c6c7c7ab7f337798157334b9db55
Aug 05 22:41:18 dist-test-slave-chsk krb5kdc[4667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969678, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:41:18.533789 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.522552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:38859 (local address 127.19.77.190:40679)
0805 22:41:18.522608 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.522611 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.522917 (+ 306us) server_negotiation.cc:407] Connection header received
0805 22:41:18.523739 (+ 822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.523740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.523754 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.523811 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:18.525337 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.526170 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.527296 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.527631 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.527710 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.530455 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:18.530457 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:18.530457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:18.530470 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:18.532146 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:18.532646 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:18.532647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:18.532648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:18.532717 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:18.533006 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:18.533007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:18.533008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:18.533154 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:18.533237 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.533579 (+ 342us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.533690 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:41:18.534006 4912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.522548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40679 (local address 127.19.77.129:38859)
0805 22:41:18.522744 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:18.522798 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:18.523616 (+ 818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:18.523891 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:18.523895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:18.524848 (+ 953us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:18.525182 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.525192 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.526306 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.526307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.527204 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.527206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.527736 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.527737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.527852 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.528484 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:18.528493 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:18.530323 (+ 1830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:18.532261 (+ 1938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:18.532275 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:18.532279 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:18.532550 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:18.532797 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:18.532797 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:18.532798 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:18.532925 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:18.533227 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:18.533235 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:18.533428 (+ 193us) client_negotiation.cc:769] Sending connection context
0805 22:41:18.533554 (+ 126us) client_negotiation.cc:240] Negotiation successful
0805 22:41:18.533740 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":99,"threads_started":1}
I20260805 22:41:18.534683 4910 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40679
I20260805 22:41:18.534795 4910 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:18.534971 4910 heartbeater.cc:511] Master 127.19.77.190:40679 requested a full tablet report, sending...
I20260805 22:41:18.535619 4712 ts_manager.cc:194] Registered new tserver with Master: d76af72d27694b218f1e7b1adaa57b8e (127.19.77.129:39591)
I20260805 22:41:18.536294 4712 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:38859
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:41:18.554557 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40679
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:18.644634 4915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:18.644896 4915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:18.644925 4915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:18.646332 4915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:18.646391 4915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:18.646421 4915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:41:18.648195 4915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:18.648509 4915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:18.648782 4915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:18.654372 4921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:18.654469 4923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:18.654556 4920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:18.654646 4915 server_base.cc:1034] running on GCE node
I20260805 22:41:18.654874 4915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:18.655261 4915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:18.656435 4915 hybrid_clock.cc:648] HybridClock initialized: now 1785969678656423 us; error 33 us; skew 500 ppm
Aug 05 22:41:18 dist-test-slave-chsk krb5kdc[4667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969678, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:18.659452 4915 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:41:18.660166 4915 webserver.cc:460] Webserver started at http://127.19.77.130:45613/ using document root <none> and password file <none>
I20260805 22:41:18.660434 4915 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:18.660512 4915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:18.660688 4915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:18.661916 4915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "81de64d385664dccb125813c028ca336"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "ca334d0d0606bacd5818a1ce231b419c"
server_key_iv: "860461586e62e9fb8c4abd08430ef0ea"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.662377 4915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "81de64d385664dccb125813c028ca336"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "ca334d0d0606bacd5818a1ce231b419c"
server_key_iv: "860461586e62e9fb8c4abd08430ef0ea"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.663956 4915 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:18.664868 4930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:18.665107 4915 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:18.665237 4915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "81de64d385664dccb125813c028ca336"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "ca334d0d0606bacd5818a1ce231b419c"
server_key_iv: "860461586e62e9fb8c4abd08430ef0ea"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.665323 4915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:18.675058 4915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:18.677385 4915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:18.677598 4915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:18.677891 4915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:18.678258 4915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:18.678318 4915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:18.678364 4915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:18.678390 4915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:18.685324 4915 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:33845
I20260805 22:41:18.685375 5047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:33845 every 8 connection(s)
I20260805 22:41:18.685748 4915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:41:18.691318 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 4915
I20260805 22:41:18.691462 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:41:18.691712 19766 external_mini_cluster.cc:1428] Setting key e01967272c2c90e772328be409316bb6
Aug 05 22:41:18 dist-test-slave-chsk krb5kdc[4667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969678, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:18.696575 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.686593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:37373 (local address 127.19.77.190:40679)
0805 22:41:18.686669 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.686671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.686870 (+ 199us) server_negotiation.cc:407] Connection header received
0805 22:41:18.687418 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.687419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.687429 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.687501 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:18.688544 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.689058 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.690103 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.690296 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.690356 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.693208 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:18.693210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:18.693210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:18.693218 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:18.694879 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:18.695450 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:18.695451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:18.695452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:18.695522 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:18.695837 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:18.695838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:18.695839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:18.695974 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:18.696062 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.696372 (+ 310us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.696477 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:41:18.696797 5050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.686537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40679 (local address 127.19.77.130:37373)
0805 22:41:18.686727 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:18.686773 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:18.687326 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:18.687559 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:18.687563 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:18.688211 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:18.688431 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.688437 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.689173 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.689173 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.690010 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.690013 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.690390 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.690391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.690503 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.691227 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:18.691239 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:18.693101 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:18.695007 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:18.695018 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:18.695023 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:18.695360 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:18.695619 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:18.695619 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:18.695620 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:18.695751 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:18.696052 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:18.696060 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:18.696221 (+ 161us) client_negotiation.cc:769] Sending connection context
0805 22:41:18.696338 (+ 117us) client_negotiation.cc:240] Negotiation successful
0805 22:41:18.696522 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":113,"threads_started":1}
I20260805 22:41:18.697521 5048 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40679
I20260805 22:41:18.697618 5048 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:18.697837 5048 heartbeater.cc:511] Master 127.19.77.190:40679 requested a full tablet report, sending...
I20260805 22:41:18.698294 4712 ts_manager.cc:194] Registered new tserver with Master: 81de64d385664dccb125813c028ca336 (127.19.77.130:33845)
I20260805 22:41:18.698696 4712 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:37373
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:41:18.722512 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40679
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:18.809804 5054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:18.810040 5054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:18.810067 5054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:18.811415 5054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:18.811468 5054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:18.811498 5054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:41:18.813115 5054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:18.813414 5054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:18.813687 5054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:18.819170 5060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:18.819165 5062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:18.819165 5059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:18.819519 5054 server_base.cc:1034] running on GCE node
I20260805 22:41:18.819767 5054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:18.820057 5054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:18.821267 5054 hybrid_clock.cc:648] HybridClock initialized: now 1785969678821256 us; error 36 us; skew 500 ppm
Aug 05 22:41:18 dist-test-slave-chsk krb5kdc[4667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969678, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:18.824121 5054 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:41:18.824616 5054 webserver.cc:460] Webserver started at http://127.19.77.131:43751/ using document root <none> and password file <none>
I20260805 22:41:18.824873 5054 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:18.824951 5054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:18.825112 5054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:18.826241 5054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "d5284b03dc324649abfe8ac046e7cb11"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "07200dafc9b238bbc8acc9c0dc5a9711"
server_key_iv: "bb42142a2dc8b88c911a0451b1d7a2cd"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.826645 5054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "d5284b03dc324649abfe8ac046e7cb11"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "07200dafc9b238bbc8acc9c0dc5a9711"
server_key_iv: "bb42142a2dc8b88c911a0451b1d7a2cd"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.828243 5054 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:18.829147 5069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:18.829360 5054 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:18.829475 5054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "d5284b03dc324649abfe8ac046e7cb11"
format_stamp: "Formatted at 2026-08-05 22:41:18 on dist-test-slave-chsk"
server_key: "07200dafc9b238bbc8acc9c0dc5a9711"
server_key_iv: "bb42142a2dc8b88c911a0451b1d7a2cd"
server_key_version: "encryptionkey@0"
I20260805 22:41:18.829568 5054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:18.839819 5054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:18.842686 5054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:18.842921 5054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:18.843261 5054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:18.843653 5054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:18.843693 5054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:18.843745 5054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:18.843772 5054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:18.849963 5054 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:32839
I20260805 22:41:18.850069 5186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:32839 every 8 connection(s)
I20260805 22:41:18.850440 5054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
Aug 05 22:41:18 dist-test-slave-chsk krb5kdc[4667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969678, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:18.858991 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 5054
I20260805 22:41:18.859131 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:41:18.859357 19766 external_mini_cluster.cc:1428] Setting key 2d0a2785e3981291e286e3eaf670bd3b
I20260805 22:41:18.860782 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.851304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:53155 (local address 127.19.77.190:40679)
0805 22:41:18.851379 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.851381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.851668 (+ 287us) server_negotiation.cc:407] Connection header received
0805 22:41:18.852149 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.852150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.852161 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.852211 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:18.853234 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.853844 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.854849 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.855031 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.855084 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.857361 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:18.857363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:18.857363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:18.857371 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:18.858869 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:18.859489 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:18.859490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:18.859491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:18.859566 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:18.859993 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:18.859994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:18.859994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:18.860145 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:18.860229 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.860598 (+ 369us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.860689 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:41:18.860996 5190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.851325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40679 (local address 127.19.77.131:53155)
0805 22:41:18.851535 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:18.851575 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:18.852059 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:18.852272 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:18.852275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:18.852881 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:18.853084 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.853111 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.853940 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.853941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.854766 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.854769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.855115 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.855116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.855299 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.855797 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:18.855806 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:18.857263 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:18.858981 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:18.858992 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:18.858994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:18.859402 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:18.859740 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:18.859741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:18.859742 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:18.859912 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:18.860222 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:18.860230 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:18.860428 (+ 198us) client_negotiation.cc:769] Sending connection context
0805 22:41:18.860558 (+ 130us) client_negotiation.cc:240] Negotiation successful
0805 22:41:18.860742 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":105,"threads_started":1}
I20260805 22:41:18.861407 5187 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40679
I20260805 22:41:18.861505 5187 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:18.861722 5187 heartbeater.cc:511] Master 127.19.77.190:40679 requested a full tablet report, sending...
I20260805 22:41:18.862120 4712 ts_manager.cc:194] Registered new tserver with Master: d5284b03dc324649abfe8ac046e7cb11 (127.19.77.131:32839)
I20260805 22:41:18.862519 4712 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:53155
I20260805 22:41:18.871562 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:41:18.879878 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.873072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41268 (local address 127.19.77.190:40679)
0805 22:41:18.873182 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.873184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.873292 (+ 108us) server_negotiation.cc:407] Connection header received
0805 22:41:18.873377 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.873378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.873389 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.873446 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:18.874067 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.874567 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.875410 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.875615 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.875708 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.877064 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:18.877065 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:18.877066 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:18.877074 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:18.878541 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:18.878919 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:18.878920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:18.878921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:18.878986 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:18.879256 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:18.879257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:18.879258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:18.879421 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:18.879533 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.879679 (+ 146us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.879762 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:41:18.881644 4712 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:41:18.883401 4712 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:41:18.890403 5203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.886227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41994 (local address 127.19.77.131:32839)
0805 22:41:18.886392 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.886397 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.886407 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:18.886472 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.886474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.886488 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.886584 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:18.886804 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.887989 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.889335 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.889913 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.889974 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.890017 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.890266 (+ 249us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.890312 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
I20260805 22:41:18.890393 5200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.885919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:32839 (local address 127.0.0.1:41994)
0805 22:41:18.886112 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:18.886146 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:18.886218 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:18.886615 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:18.886619 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:18.886621 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:18.886713 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.886716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.888109 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.888110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.889234 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.889236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.890039 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.890040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.890130 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.890145 (+ 15us) client_negotiation.cc:769] Sending connection context
0805 22:41:18.890220 (+ 75us) client_negotiation.cc:240] Negotiation successful
0805 22:41:18.890286 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":7,"thread_start_us":114,"threads_started":1}
I20260805 22:41:18.890565 5205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.886490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37576 (local address 127.19.77.130:33845)
0805 22:41:18.886719 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.886723 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.886892 (+ 169us) server_negotiation.cc:407] Connection header received
0805 22:41:18.886938 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.886940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.886956 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.887024 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:18.887251 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.888285 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.889472 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.890007 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.890086 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.890144 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.890440 (+ 296us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.890484 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":98,"threads_started":1}
I20260805 22:41:18.890398 5202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.885936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:33845 (local address 127.0.0.1:37576)
0805 22:41:18.886772 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:18.886783 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:18.886837 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:18.887103 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:18.887104 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:18.887106 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:18.887177 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.887179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.888397 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.888398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.889381 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.889384 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.890127 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.890128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.890193 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.890198 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:41:18.890254 (+ 56us) client_negotiation.cc:240] Negotiation successful
0805 22:41:18.890298 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"mutex_wait_us":2,"thread_start_us":99,"threads_started":1}
I20260805 22:41:18.891258 5201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.885919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:39591 (local address 127.0.0.1:38216)
0805 22:41:18.886096 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:18.886143 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:18.886218 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:18.886625 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:18.886626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:18.886629 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:18.886721 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.886723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.887865 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.887866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.889233 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.889236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.890951 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.890952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.891034 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.891039 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:41:18.891109 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:41:18.891180 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":4,"thread_start_us":87,"threads_started":1}
I20260805 22:41:18.891371 5204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.886228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38216 (local address 127.19.77.129:39591)
0805 22:41:18.886412 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.886417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.886436 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:41:18.886488 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.886490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.886506 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.886811 (+ 305us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:18.886895 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.887751 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.890083 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.890860 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.890916 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.890997 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.891225 (+ 228us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.891272 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":114,"threads_started":1}
I20260805 22:41:18.891655 4979 tablet_service.cc:1467] Processing CreateTablet for tablet 1cb2269e5d4d4b49bdfe10bbd48601b7 (DEFAULT_TABLE table=test-table [id=38e723733ff248b4a2c458b357348738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:18.892033 4979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cb2269e5d4d4b49bdfe10bbd48601b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:18.892040 4843 tablet_service.cc:1467] Processing CreateTablet for tablet 1cb2269e5d4d4b49bdfe10bbd48601b7 (DEFAULT_TABLE table=test-table [id=38e723733ff248b4a2c458b357348738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:18.892313 4843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cb2269e5d4d4b49bdfe10bbd48601b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:18.895299 5207 tablet_bootstrap.cc:492] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e: Bootstrap starting.
I20260805 22:41:18.895422 5206 tablet_bootstrap.cc:492] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: Bootstrap starting.
I20260805 22:41:18.896081 5206 tablet_bootstrap.cc:654] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:18.896081 5207 tablet_bootstrap.cc:654] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:18.896044 5119 tablet_service.cc:1467] Processing CreateTablet for tablet 1cb2269e5d4d4b49bdfe10bbd48601b7 (DEFAULT_TABLE table=test-table [id=38e723733ff248b4a2c458b357348738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:18.896389 5119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cb2269e5d4d4b49bdfe10bbd48601b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:18.896763 5207 log.cc:824] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:18.896763 5206 log.cc:824] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:18.897644 5207 tablet_bootstrap.cc:492] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e: No bootstrap required, opened a new log
I20260805 22:41:18.897713 5207 ts_tablet_manager.cc:1397] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:41:18.897946 5206 tablet_bootstrap.cc:492] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: No bootstrap required, opened a new log
I20260805 22:41:18.898005 5206 ts_tablet_manager.cc:1397] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:41:18.899844 5207 raft_consensus.cc:348] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 } } peers { permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 } } peers { permanent_uuid: "d5284b03dc324649abfe8ac046e7cb11" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 32839 } }
I20260805 22:41:18.900053 5207 raft_consensus.cc:374] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:18.900096 5207 raft_consensus.cc:729] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d76af72d27694b218f1e7b1adaa57b8e, State: Initialized, Role: FOLLOWER
I20260805 22:41:18.900117 5206 raft_consensus.cc:348] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 } } peers { permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 } } peers { permanent_uuid: "d5284b03dc324649abfe8ac046e7cb11" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 32839 } }
I20260805 22:41:18.900254 5207 consensus_queue.cc:260] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 } } peers { permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 } } peers { permanent_uuid: "d5284b03dc324649abfe8ac046e7cb11" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 32839 } }
I20260805 22:41:18.900300 5206 raft_consensus.cc:374] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:18.900339 5206 raft_consensus.cc:729] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81de64d385664dccb125813c028ca336, State: Initialized, Role: FOLLOWER
I20260805 22:41:18.900455 5206 consensus_queue.cc:260] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 } } peers { permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 } } peers { permanent_uuid: "d5284b03dc324649abfe8ac046e7cb11" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 32839 } }
I20260805 22:41:18.900584 5207 ts_tablet_manager.cc:1428] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:41:18.900624 4910 heartbeater.cc:503] Master 127.19.77.190:40679 was elected leader, sending a full tablet report...
I20260805 22:41:18.901069 5206 ts_tablet_manager.cc:1428] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:41:18.901093 5048 heartbeater.cc:503] Master 127.19.77.190:40679 was elected leader, sending a full tablet report...
I20260805 22:41:18.901304 5210 tablet_bootstrap.cc:492] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: Bootstrap starting.
I20260805 22:41:18.902186 5210 tablet_bootstrap.cc:654] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:18.902798 5210 log.cc:824] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:18.903628 5210 tablet_bootstrap.cc:492] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: No bootstrap required, opened a new log
I20260805 22:41:18.903690 5210 ts_tablet_manager.cc:1397] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:41:18.905197 5210 raft_consensus.cc:348] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 } } peers { permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 } } peers { permanent_uuid: "d5284b03dc324649abfe8ac046e7cb11" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 32839 } }
I20260805 22:41:18.905351 5210 raft_consensus.cc:374] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:18.905375 5210 raft_consensus.cc:729] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5284b03dc324649abfe8ac046e7cb11, State: Initialized, Role: FOLLOWER
I20260805 22:41:18.905463 5210 consensus_queue.cc:260] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 } } peers { permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 } } peers { permanent_uuid: "d5284b03dc324649abfe8ac046e7cb11" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 32839 } }
I20260805 22:41:18.905704 5210 ts_tablet_manager.cc:1428] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:41:18.905750 5187 heartbeater.cc:503] Master 127.19.77.190:40679 was elected leader, sending a full tablet report...
I20260805 22:41:18.928901 5214 raft_consensus.cc:482] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:18.929047 5214 raft_consensus.cc:504] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 } } peers { permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 } } peers { permanent_uuid: "d5284b03dc324649abfe8ac046e7cb11" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 32839 } }
I20260805 22:41:18.929419 5214 leader_election.cc:288] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d76af72d27694b218f1e7b1adaa57b8e (127.19.77.129:39591), 81de64d385664dccb125813c028ca336 (127.19.77.130:33845)
I20260805 22:41:18.932605 5190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.929617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:33845 (local address 127.19.77.131:50975)
0805 22:41:18.929678 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:18.929691 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:18.929741 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:18.929919 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:18.929920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:18.929922 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:18.930005 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.930007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.930686 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.930688 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.931570 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.931574 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.932291 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.932292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.932382 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.932387 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:41:18.932454 (+ 67us) client_negotiation.cc:240] Negotiation successful
0805 22:41:18.932501 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260805 22:41:18.932608 5205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.929725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:50975 (local address 127.19.77.130:33845)
0805 22:41:18.929771 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.929773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.929783 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:18.929816 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.929817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.929835 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.929912 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:18.930092 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.930576 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.931682 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.932199 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.932368 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.932384 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.932474 (+ 90us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.932519 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:41:18.932945 5204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.929712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:51143 (local address 127.19.77.129:39591)
0805 22:41:18.929769 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.929771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.929952 (+ 181us) server_negotiation.cc:407] Connection header received
0805 22:41:18.930032 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.930033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.930045 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.930136 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:18.930305 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.930778 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.931924 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.932511 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.932579 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.932588 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.932801 (+ 213us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.932845 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260805 22:41:18.933236 5215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.929640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:39591 (local address 127.19.77.131:51143)
0805 22:41:18.929852 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:18.929866 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:18.929963 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:18.930143 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:18.930144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:18.930145 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:18.930226 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.930228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.930873 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.930874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.931785 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:18.931788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.932623 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.932625 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:18.932706 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.932710 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:41:18.933123 (+ 413us) client_negotiation.cc:240] Negotiation successful
0805 22:41:18.933179 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":151,"threads_started":1}
I20260805 22:41:18.933166 4999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cb2269e5d4d4b49bdfe10bbd48601b7" candidate_uuid: "d5284b03dc324649abfe8ac046e7cb11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81de64d385664dccb125813c028ca336" is_pre_election: true
I20260805 22:41:18.933393 4999 raft_consensus.cc:2454] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5284b03dc324649abfe8ac046e7cb11 in term 0.
I20260805 22:41:18.933672 4863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cb2269e5d4d4b49bdfe10bbd48601b7" candidate_uuid: "d5284b03dc324649abfe8ac046e7cb11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d76af72d27694b218f1e7b1adaa57b8e" is_pre_election: true
I20260805 22:41:18.933725 5073 leader_election.cc:302] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81de64d385664dccb125813c028ca336, d5284b03dc324649abfe8ac046e7cb11; no voters:
I20260805 22:41:18.933861 4863 raft_consensus.cc:2454] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5284b03dc324649abfe8ac046e7cb11 in term 0.
I20260805 22:41:18.933876 5214 raft_consensus.cc:2781] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:41:18.933920 5214 raft_consensus.cc:482] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:41:18.933944 5214 raft_consensus.cc:3037] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:18.934731 5214 raft_consensus.cc:504] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 } } peers { permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 } } peers { permanent_uuid: "d5284b03dc324649abfe8ac046e7cb11" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 32839 } }
I20260805 22:41:18.934897 5214 leader_election.cc:288] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [CANDIDATE]: Term 1 election: Requested vote from peers d76af72d27694b218f1e7b1adaa57b8e (127.19.77.129:39591), 81de64d385664dccb125813c028ca336 (127.19.77.130:33845)
I20260805 22:41:18.935057 4863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cb2269e5d4d4b49bdfe10bbd48601b7" candidate_uuid: "d5284b03dc324649abfe8ac046e7cb11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d76af72d27694b218f1e7b1adaa57b8e"
I20260805 22:41:18.935096 4999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cb2269e5d4d4b49bdfe10bbd48601b7" candidate_uuid: "d5284b03dc324649abfe8ac046e7cb11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81de64d385664dccb125813c028ca336"
I20260805 22:41:18.935209 4863 raft_consensus.cc:3037] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:18.935273 4999 raft_consensus.cc:3037] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:18.936064 4863 raft_consensus.cc:2454] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5284b03dc324649abfe8ac046e7cb11 in term 1.
I20260805 22:41:18.936218 4999 raft_consensus.cc:2454] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5284b03dc324649abfe8ac046e7cb11 in term 1.
I20260805 22:41:18.936280 5070 leader_election.cc:302] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5284b03dc324649abfe8ac046e7cb11, d76af72d27694b218f1e7b1adaa57b8e; no voters:
W20260805 22:41:18.936317 5049 tablet.cc:2369] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:41:18.936441 5214 raft_consensus.cc:2781] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:18.936636 5214 raft_consensus.cc:686] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 1 LEADER]: Becoming Leader. State: Replica: d5284b03dc324649abfe8ac046e7cb11, State: Running, Role: LEADER
I20260805 22:41:18.936748 5214 consensus_queue.cc:237] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 } } peers { permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 } } peers { permanent_uuid: "d5284b03dc324649abfe8ac046e7cb11" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 32839 } }
I20260805 22:41:18.937804 4711 catalog_manager.cc:5495] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5284b03dc324649abfe8ac046e7cb11 (127.19.77.131). New cstate: current_term: 1 leader_uuid: "d5284b03dc324649abfe8ac046e7cb11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5284b03dc324649abfe8ac046e7cb11" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 32839 } health_report { overall_health: HEALTHY } } }
I20260805 22:41:18.950713 5203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.948254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42010 (local address 127.19.77.131:32839)
0805 22:41:18.948331 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:18.948333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:18.948343 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:18.948398 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:18.948399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:18.948419 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:18.948492 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:18.948673 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.949174 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.949946 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:18.950145 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:18.950210 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:18.950380 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:18.950494 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:18.950561 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:18.950595 (+ 34us) server_negotiation.cc:299] Negotiation successful
0805 22:41:18.950614 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260805 22:41:18.953023 4999 raft_consensus.cc:1261] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336 [term 1 FOLLOWER]: Refusing update from remote peer d5284b03dc324649abfe8ac046e7cb11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:18.953022 4863 raft_consensus.cc:1261] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e [term 1 FOLLOWER]: Refusing update from remote peer d5284b03dc324649abfe8ac046e7cb11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:18.953460 5214 consensus_queue.cc:1035] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81de64d385664dccb125813c028ca336" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:18.953660 5216 consensus_queue.cc:1035] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d76af72d27694b218f1e7b1adaa57b8e" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:18.957330 5220 mvcc.cc:205] Tried to move back new op lower bound from 7315331804988096512 to 7315331804925972480. Current Snapshot: MvccSnapshot[applied={T|T < 7315331804988096512}]
I20260805 22:41:18.956866 5221 mvcc.cc:205] Tried to move back new op lower bound from 7315331804988096512 to 7315331804925972480. Current Snapshot: MvccSnapshot[applied={T|T < 7315331804988096512}]
I20260805 22:41:18.958818 4710 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:18.958935 4710 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:18.959869 4710 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 103fd403185242b68aae81e2358e4cb1: Sending DeleteTablet for 3 replicas of tablet 1cb2269e5d4d4b49bdfe10bbd48601b7
I20260805 22:41:18.960266 4979 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cb2269e5d4d4b49bdfe10bbd48601b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:18 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:37576
I20260805 22:41:18.960258 5119 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cb2269e5d4d4b49bdfe10bbd48601b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:18 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:41994
I20260805 22:41:18.960294 4843 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cb2269e5d4d4b49bdfe10bbd48601b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:18 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:38216
I20260805 22:41:18.960575 5229 tablet_replica.cc:330] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: stopping tablet replica
I20260805 22:41:18.960704 5228 tablet_replica.cc:330] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: stopping tablet replica
I20260805 22:41:18.960762 5230 tablet_replica.cc:330] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e: stopping tablet replica
I20260805 22:41:18.960846 5228 raft_consensus.cc:2229] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:41:18.960947 5230 raft_consensus.cc:2229] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d76af72d27694b218f1e7b1adaa57b8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:41:18.961020 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 4777
I20260805 22:41:18.962827 5229 raft_consensus.cc:2229] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:41:18.962988 5229 raft_consensus.cc:2258] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:18.963186 5228 raft_consensus.cc:2258] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:18.963807 5229 ts_tablet_manager.cc:1905] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:18.963807 5228 ts_tablet_manager.cc:1905] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:18.966038 5228 ts_tablet_manager.cc:1918] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:18.966032 5229 ts_tablet_manager.cc:1918] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:18.966138 5229 log.cc:1196] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/1cb2269e5d4d4b49bdfe10bbd48601b7
I20260805 22:41:18.966164 5228 log.cc:1196] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/1cb2269e5d4d4b49bdfe10bbd48601b7
I20260805 22:41:18.966496 5228 ts_tablet_manager.cc:1939] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P d5284b03dc324649abfe8ac046e7cb11: Deleting consensus metadata
I20260805 22:41:18.966495 5229 ts_tablet_manager.cc:1939] T 1cb2269e5d4d4b49bdfe10bbd48601b7 P 81de64d385664dccb125813c028ca336: Deleting consensus metadata
I20260805 22:41:18.966965 4699 catalog_manager.cc:4841] TS 81de64d385664dccb125813c028ca336 (127.19.77.130:33845): tablet 1cb2269e5d4d4b49bdfe10bbd48601b7 (table test-table [id=38e723733ff248b4a2c458b357348738]) successfully deleted
I20260805 22:41:18.967031 4697 catalog_manager.cc:4841] TS d5284b03dc324649abfe8ac046e7cb11 (127.19.77.131:32839): tablet 1cb2269e5d4d4b49bdfe10bbd48601b7 (table test-table [id=38e723733ff248b4a2c458b357348738]) successfully deleted
W20260805 22:41:18.969605 4696 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:39591 (error 108)
I20260805 22:41:18.969906 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 4915
I20260805 22:41:18.977803 5201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:18.977639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:39591 (local address 127.0.0.1:38224)
0805 22:41:18.977710 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:18.977766 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:39591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260805 22:41:18.977785 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 5054
W20260805 22:41:18.979811 4696 catalog_manager.cc:4584] TS d76af72d27694b218f1e7b1adaa57b8e (127.19.77.129:39591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1cb2269e5d4d4b49bdfe10bbd48601b7: Network error: Client connection negotiation failed: client connection to 127.19.77.129:39591: connect: Connection refused (error 111)
I20260805 22:41:18.983448 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 4680
2026-08-05T22:41:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2056 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-05T22:41:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:19Z Disabled control of system clock
I20260805 22:41:19.014628 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:37609
--webserver_interface=127.19.77.190
--webserver_port=0
--builtin_ntp_servers=127.19.77.148:35605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:37609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:41:19.099939 5235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:19.100199 5235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:19.100224 5235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:19.101541 5235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:19.101596 5235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:19.101610 5235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:19.101624 5235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:19.101636 5235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:19.103199 5235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:37609
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:37609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:19.103505 5235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:19.103852 5235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:19.109051 5240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:19.109084 5245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:19.109108 5243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:19.109647 5235 server_base.cc:1034] running on GCE node
I20260805 22:41:19.109880 5235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:19.110183 5235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:19.111339 5235 hybrid_clock.cc:648] HybridClock initialized: now 1785969679111328 us; error 35 us; skew 500 ppm
I20260805 22:41:19.112947 5235 webserver.cc:460] Webserver started at http://127.19.77.190:37829/ using document root <none> and password file <none>
I20260805 22:41:19.113277 5235 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:19.113330 5235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:19.113517 5235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:19.114709 5235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "209861416ea54e4b999e7f44ecac9d0b"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "345e7313ef10e8d5faaf86ffa1d60375"
server_key_iv: "4ca6fa4d278d6583bda7c981d25fad53"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.115126 5235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "209861416ea54e4b999e7f44ecac9d0b"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "345e7313ef10e8d5faaf86ffa1d60375"
server_key_iv: "4ca6fa4d278d6583bda7c981d25fad53"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.116670 5235 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:19.117609 5251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:19.117823 5235 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:19.117938 5235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "209861416ea54e4b999e7f44ecac9d0b"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "345e7313ef10e8d5faaf86ffa1d60375"
server_key_iv: "4ca6fa4d278d6583bda7c981d25fad53"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.118041 5235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:19.132392 5235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:19.132779 5235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:19.132956 5235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:19.137666 5235 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:37609
I20260805 22:41:19.137707 5304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:37609 every 8 connection(s)
I20260805 22:41:19.138126 5235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:19.139230 5305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:19.140098 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 5235
I20260805 22:41:19.140234 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:19.140439 19766 external_mini_cluster.cc:1428] Setting key 1e745939c53ac2ffd085acd58bfc295f
I20260805 22:41:19.142541 5305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b: Bootstrap starting.
I20260805 22:41:19.143344 5305 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:19.143659 5305 log.cc:824] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:19.144447 5305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b: No bootstrap required, opened a new log
I20260805 22:41:19.146330 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.141081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49902 (local address 127.19.77.190:37609)
0805 22:41:19.141327 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.141335 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.141360 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:41:19.141798 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.141804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.141865 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.142027 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:19.142277 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.143318 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.144242 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.144734 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.144872 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.145674 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:19.145678 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:19.145678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:19.145853 (+ 175us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:19.145887 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:19.145898 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:19.145982 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.146058 (+ 76us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.146142 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":112,"threads_started":1}
I20260805 22:41:19.146848 5305 raft_consensus.cc:348] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209861416ea54e4b999e7f44ecac9d0b" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 37609 } }
I20260805 22:41:19.147033 5305 raft_consensus.cc:374] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:19.147073 5305 raft_consensus.cc:729] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 209861416ea54e4b999e7f44ecac9d0b, State: Initialized, Role: FOLLOWER
I20260805 22:41:19.147262 5305 consensus_queue.cc:260] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209861416ea54e4b999e7f44ecac9d0b" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 37609 } }
I20260805 22:41:19.147333 5305 raft_consensus.cc:388] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:19.147356 5305 raft_consensus.cc:482] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:19.147383 5305 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:19.147966 5305 raft_consensus.cc:504] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209861416ea54e4b999e7f44ecac9d0b" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 37609 } }
I20260805 22:41:19.148051 5305 leader_election.cc:302] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 209861416ea54e4b999e7f44ecac9d0b; no voters:
I20260805 22:41:19.148204 5305 leader_election.cc:288] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:19.148274 5310 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:19.148423 5310 raft_consensus.cc:686] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [term 1 LEADER]: Becoming Leader. State: Replica: 209861416ea54e4b999e7f44ecac9d0b, State: Running, Role: LEADER
I20260805 22:41:19.148515 5305 sys_catalog.cc:564] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:19.148530 5310 consensus_queue.cc:237] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209861416ea54e4b999e7f44ecac9d0b" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 37609 } }
I20260805 22:41:19.148909 5310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 209861416ea54e4b999e7f44ecac9d0b. Latest consensus state: current_term: 1 leader_uuid: "209861416ea54e4b999e7f44ecac9d0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209861416ea54e4b999e7f44ecac9d0b" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 37609 } } }
I20260805 22:41:19.149034 5310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:19.148921 5313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "209861416ea54e4b999e7f44ecac9d0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209861416ea54e4b999e7f44ecac9d0b" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 37609 } } }
I20260805 22:41:19.149240 5313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:19.149251 5317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:19.149832 5317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:19.151590 5317 catalog_manager.cc:1347] Generated new cluster ID: 29a22cc197b0402da43c064fb2af823e
I20260805 22:41:19.151648 5317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:19.160915 5317 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:19.161567 5317 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:19.167874 5317 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b: Generated new TSK 0
I20260805 22:41:19.168114 5317 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:19.170758 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:37609
--builtin_ntp_servers=127.19.77.148:35605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:41:19.263005 5330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:19.263350 5330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:19.263398 5330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:19.265414 5330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:19.265532 5330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:19.265589 5330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:41:19.267426 5330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:37609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:19.267757 5330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:19.268105 5330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:19.274570 5337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:19.274580 5339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:19.274580 5335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:19.275117 5330 server_base.cc:1034] running on GCE node
I20260805 22:41:19.275393 5330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:19.275666 5330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:19.276844 5330 hybrid_clock.cc:648] HybridClock initialized: now 1785969679276822 us; error 48 us; skew 500 ppm
I20260805 22:41:19.278254 5330 webserver.cc:460] Webserver started at http://127.19.77.129:33081/ using document root <none> and password file <none>
I20260805 22:41:19.278532 5330 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:19.278606 5330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:19.278759 5330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:19.280061 5330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "af6e5f1475f24d8fbc000bff19c55144"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "498b5c2e5ca4e0798597eb68637258dc"
server_key_iv: "5e8ce264b3c2a76aa6141147b4d0d72d"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.280468 5330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "af6e5f1475f24d8fbc000bff19c55144"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "498b5c2e5ca4e0798597eb68637258dc"
server_key_iv: "5e8ce264b3c2a76aa6141147b4d0d72d"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.281935 5330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:41:19.282826 5345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:19.283034 5330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:19.283144 5330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "af6e5f1475f24d8fbc000bff19c55144"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "498b5c2e5ca4e0798597eb68637258dc"
server_key_iv: "5e8ce264b3c2a76aa6141147b4d0d72d"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.283282 5330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:19.294600 5330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:19.294991 5330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:19.295212 5330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:19.295498 5330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:19.295871 5330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:19.295933 5330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:19.295982 5330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:19.296017 5330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:19.302748 5330 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:45101
I20260805 22:41:19.302793 5462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:45101 every 8 connection(s)
I20260805 22:41:19.303223 5330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:41:19.307266 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 5330
I20260805 22:41:19.307400 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:41:19.307606 19766 external_mini_cluster.cc:1428] Setting key 63a17604768eca53afbdc142495872f6
I20260805 22:41:19.308709 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:37609
--builtin_ntp_servers=127.19.77.148:35605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:41:19.309755 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.304013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:49599 (local address 127.19.77.190:37609)
0805 22:41:19.304081 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.304083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.304348 (+ 265us) server_negotiation.cc:407] Connection header received
0805 22:41:19.304910 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.304911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.304928 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.304995 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:19.305741 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.306253 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.307943 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.308216 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.308317 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.309429 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:19.309431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:19.309431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:19.309436 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:19.309452 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:19.309457 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:19.309520 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.309632 (+ 112us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.309675 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:41:19.309996 5465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.303991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:37609 (local address 127.19.77.129:49599)
0805 22:41:19.304199 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:19.304236 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:19.304783 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:19.305077 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:19.305081 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:19.305089 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:19.305622 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.305626 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.306372 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.306373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.307776 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.307780 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.308359 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.308360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.308537 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.309232 (+ 695us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:41:19.309232 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:19.309275 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:41:19.309315 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:19.309522 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:19.309529 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:19.309533 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:41:19.309635 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 22:41:19.309753 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":102,"threads_started":1}
I20260805 22:41:19.310967 5463 heartbeater.cc:347] Connected to a master server at 127.19.77.190:37609
I20260805 22:41:19.311131 5463 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:19.311401 5463 heartbeater.cc:511] Master 127.19.77.190:37609 requested a full tablet report, sending...
I20260805 22:41:19.312136 5268 ts_manager.cc:194] Registered new tserver with Master: af6e5f1475f24d8fbc000bff19c55144 (127.19.77.129:45101)
I20260805 22:41:19.312822 5268 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.129:49599
W20260805 22:41:19.396355 5466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:19.396631 5466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:19.396674 5466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:19.397970 5466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:19.398061 5466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:19.398108 5466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:41:19.399715 5466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:37609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:19.400034 5466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:19.400385 5466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:19.405895 5471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:19.405898 5474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:19.406116 5466 server_base.cc:1034] running on GCE node
W20260805 22:41:19.405906 5472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:19.406491 5466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:19.406733 5466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:19.407883 5466 hybrid_clock.cc:648] HybridClock initialized: now 1785969679407862 us; error 43 us; skew 500 ppm
I20260805 22:41:19.409394 5466 webserver.cc:460] Webserver started at http://127.19.77.130:33781/ using document root <none> and password file <none>
I20260805 22:41:19.409688 5466 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:19.409742 5466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:19.409929 5466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:19.411073 5466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "a9a8452e89a54a38877489f1fd177997"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "c05d41f6f343e9d66070c9af71c3fc7d"
server_key_iv: "ead3cfdb61194f18dcafb06a50d57788"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.411545 5466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "a9a8452e89a54a38877489f1fd177997"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "c05d41f6f343e9d66070c9af71c3fc7d"
server_key_iv: "ead3cfdb61194f18dcafb06a50d57788"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.412997 5466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:19.413885 5480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:19.414120 5466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:19.414235 5466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "a9a8452e89a54a38877489f1fd177997"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "c05d41f6f343e9d66070c9af71c3fc7d"
server_key_iv: "ead3cfdb61194f18dcafb06a50d57788"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.414323 5466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:19.425870 5466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:19.426246 5466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:19.426414 5466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:19.426672 5466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:19.427032 5466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:19.427094 5466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:19.427214 5466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:19.427268 5466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:19.433473 5466 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:36371
I20260805 22:41:19.433537 5599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:36371 every 8 connection(s)
I20260805 22:41:19.433940 5466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:41:19.435925 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 5466
I20260805 22:41:19.436034 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:41:19.436250 19766 external_mini_cluster.cc:1428] Setting key ea776bdcd969c3fc4a5ae3855be9d657
I20260805 22:41:19.437464 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:37609
--builtin_ntp_servers=127.19.77.148:35605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:41:19.440665 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.434818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:49439 (local address 127.19.77.190:37609)
0805 22:41:19.434895 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.434898 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.435119 (+ 221us) server_negotiation.cc:407] Connection header received
0805 22:41:19.435767 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.435768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.435782 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.435838 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:19.436774 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.437385 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.438938 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.439216 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.439317 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.440355 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:19.440356 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:19.440357 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:19.440362 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:19.440377 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:19.440381 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:19.440436 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.440548 (+ 112us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.440578 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260805 22:41:19.440933 5602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.434764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:37609 (local address 127.19.77.130:49439)
0805 22:41:19.434981 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:19.435018 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:19.435617 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:19.435914 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:19.435918 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:19.435930 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:19.436632 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.436640 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.437501 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.437502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.438838 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.438841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.439332 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.439333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.439501 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.440171 (+ 670us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:41:19.440172 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:19.440206 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:41:19.440232 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:19.440458 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:19.440463 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:19.440466 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:19.440542 (+ 76us) client_negotiation.cc:240] Negotiation successful
0805 22:41:19.440660 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":69,"threads_started":1}
I20260805 22:41:19.441499 5600 heartbeater.cc:347] Connected to a master server at 127.19.77.190:37609
I20260805 22:41:19.441628 5600 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:19.441890 5600 heartbeater.cc:511] Master 127.19.77.190:37609 requested a full tablet report, sending...
I20260805 22:41:19.442391 5268 ts_manager.cc:194] Registered new tserver with Master: a9a8452e89a54a38877489f1fd177997 (127.19.77.130:36371)
I20260805 22:41:19.442984 5268 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.130:49439
W20260805 22:41:19.526432 5603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:19.526662 5603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:19.526690 5603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:19.527983 5603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:19.528035 5603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:19.528064 5603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:41:19.529484 5603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:35605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:37609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:19.529712 5603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:19.530009 5603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:19.535565 5608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:19.535677 5609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:19.535609 5611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:19.535995 5603 server_base.cc:1034] running on GCE node
I20260805 22:41:19.536201 5603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:19.536507 5603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:19.537688 5603 hybrid_clock.cc:648] HybridClock initialized: now 1785969679537671 us; error 33 us; skew 500 ppm
I20260805 22:41:19.539320 5603 webserver.cc:460] Webserver started at http://127.19.77.131:45277/ using document root <none> and password file <none>
I20260805 22:41:19.539630 5603 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:19.539685 5603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:19.539886 5603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:19.541060 5603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "95e345618d4e452d8ea048998e30a90d"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "841de0ea14c02fd216588627b871b758"
server_key_iv: "a1ef11652991160fa00a1e38b6f4e2b9"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.541448 5603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "95e345618d4e452d8ea048998e30a90d"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "841de0ea14c02fd216588627b871b758"
server_key_iv: "a1ef11652991160fa00a1e38b6f4e2b9"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.542966 5603 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:19.543921 5618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:19.544152 5603 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:19.544261 5603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "95e345618d4e452d8ea048998e30a90d"
format_stamp: "Formatted at 2026-08-05 22:41:19 on dist-test-slave-chsk"
server_key: "841de0ea14c02fd216588627b871b758"
server_key_iv: "a1ef11652991160fa00a1e38b6f4e2b9"
server_key_version: "encryptionkey@0"
I20260805 22:41:19.544359 5603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:19.557107 5603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:19.557495 5603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:19.557683 5603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:19.557956 5603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:19.558326 5603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:19.558390 5603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:19.558437 5603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:19.558465 5603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:19.565200 5603 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:37613
I20260805 22:41:19.565306 5733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:37613 every 8 connection(s)
I20260805 22:41:19.565685 5603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:41:19.571470 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.566572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:40725 (local address 127.19.77.190:37609)
0805 22:41:19.566666 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.566669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.566873 (+ 204us) server_negotiation.cc:407] Connection header received
0805 22:41:19.567488 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.567490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.567500 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.567565 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:19.568268 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.568775 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.569894 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.570096 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.570166 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.571129 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:19.571130 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:19.571130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:19.571135 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:19.571214 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:19.571219 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:19.571286 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.571378 (+ 92us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.571402 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 22:41:19.571714 5736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.566520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:37609 (local address 127.19.77.131:40725)
0805 22:41:19.566742 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:19.566781 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:19.567386 (+ 605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:19.567623 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:19.567631 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:19.567640 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:19.568182 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.568187 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.568883 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.568883 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.569723 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.569725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.570206 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.570206 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.570328 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.570964 (+ 636us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:41:19.570965 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:19.570997 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:41:19.571024 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:19.571295 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:19.571300 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:19.571303 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:19.571362 (+ 59us) client_negotiation.cc:240] Negotiation successful
0805 22:41:19.571459 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":118,"threads_started":1}
I20260805 22:41:19.572279 5734 heartbeater.cc:347] Connected to a master server at 127.19.77.190:37609
I20260805 22:41:19.572410 5734 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:19.572639 5734 heartbeater.cc:511] Master 127.19.77.190:37609 requested a full tablet report, sending...
I20260805 22:41:19.573169 5268 ts_manager.cc:194] Registered new tserver with Master: 95e345618d4e452d8ea048998e30a90d (127.19.77.131:37613)
I20260805 22:41:19.573534 5268 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.131:40725
I20260805 22:41:19.574538 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 5603
I20260805 22:41:19.574666 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:41:19.574891 19766 external_mini_cluster.cc:1428] Setting key ae37cac03eea05f83c72ac0d925b9d72
I20260805 22:41:19.576126 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:41:19.580957 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.577657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49918 (local address 127.19.77.190:37609)
0805 22:41:19.577752 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.577755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.577864 (+ 109us) server_negotiation.cc:407] Connection header received
0805 22:41:19.577956 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.577957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.577968 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.578039 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:19.578232 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.578741 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.579649 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.579851 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.579936 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.580645 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:19.580647 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:19.580647 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:19.580653 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:19.580670 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:19.580679 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:19.580744 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.580822 (+ 78us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.580846 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 22:41:19.582932 5268 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:41:19.584607 5268 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:41:19.591382 5748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.587468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46888 (local address 127.19.77.131:37613)
0805 22:41:19.587682 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.587687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.587773 (+ 86us) server_negotiation.cc:407] Connection header received
0805 22:41:19.587827 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.587829 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.587845 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.587924 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:19.588201 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.588985 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.590381 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.590911 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.591018 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.591121 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.591232 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.591272 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":98,"threads_started":1}
I20260805 22:41:19.591360 5746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.587042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:37613 (local address 127.0.0.1:46888)
0805 22:41:19.587663 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:19.587675 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:19.587751 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:19.587996 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:19.587997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:19.587999 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:19.588048 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.588050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.589083 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.589084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.590279 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.590281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.591017 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.591018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.591099 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.591113 (+ 14us) client_negotiation.cc:769] Sending connection context
0805 22:41:19.591217 (+ 104us) client_negotiation.cc:240] Negotiation successful
0805 22:41:19.591272 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":14,"thread_start_us":105,"threads_started":1}
I20260805 22:41:19.591980 5743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.587041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:45101 (local address 127.0.0.1:41052)
0805 22:41:19.587206 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:19.587258 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:19.587335 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:19.587605 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:19.587608 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:19.587610 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:19.587701 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.587708 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.588877 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.588878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.590349 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.590351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.591407 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.591409 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.591781 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.591786 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:41:19.591852 (+ 66us) client_negotiation.cc:240] Negotiation successful
0805 22:41:19.591894 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":62,"thread_start_us":80,"threads_started":1}
I20260805 22:41:19.591998 5745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.587158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41052 (local address 127.19.77.129:45101)
0805 22:41:19.587407 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.587413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.587422 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:19.587462 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.587464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.587484 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.587583 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:19.587825 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.588779 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.590446 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.591224 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.591286 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.591372 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.591872 (+ 500us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.591917 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":129,"threads_started":1}
I20260805 22:41:19.592202 5667 tablet_service.cc:1467] Processing CreateTablet for tablet 9fd738c682f64895b113994f0c6f6851 (DEFAULT_TABLE table=test-table [id=06e3c660c52344d1bca046d1f6bdfad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:19.592597 5744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.587322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:36371 (local address 127.0.0.1:60558)
0805 22:41:19.587734 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:19.587743 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:19.587785 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:19.589076 (+ 1291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:19.589077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:19.589079 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:19.589127 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.589130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.590032 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.590033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.591206 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.591210 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.592349 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.592351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.592415 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.592420 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:41:19.592480 (+ 60us) client_negotiation.cc:240] Negotiation successful
0805 22:41:19.592526 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":1,"thread_start_us":69,"threads_started":1}
I20260805 22:41:19.592653 5667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fd738c682f64895b113994f0c6f6851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:19.592845 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.587435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60558 (local address 127.19.77.130:36371)
0805 22:41:19.588923 (+ 1488us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.588926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.588934 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:41:19.588966 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.588968 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.588979 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.589076 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:19.589186 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.589928 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.591316 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.592131 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.592204 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.592312 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.592703 (+ 391us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.592751 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1450,"thread_start_us":124,"threads_started":1}
I20260805 22:41:19.595465 5749 tablet_bootstrap.cc:492] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: Bootstrap starting.
I20260805 22:41:19.595933 5531 tablet_service.cc:1467] Processing CreateTablet for tablet 9fd738c682f64895b113994f0c6f6851 (DEFAULT_TABLE table=test-table [id=06e3c660c52344d1bca046d1f6bdfad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:19.595929 5395 tablet_service.cc:1467] Processing CreateTablet for tablet 9fd738c682f64895b113994f0c6f6851 (DEFAULT_TABLE table=test-table [id=06e3c660c52344d1bca046d1f6bdfad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:19.596269 5531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fd738c682f64895b113994f0c6f6851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:19.596341 5395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fd738c682f64895b113994f0c6f6851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:19.598838 5750 tablet_bootstrap.cc:492] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: Bootstrap starting.
I20260805 22:41:19.599167 5751 tablet_bootstrap.cc:492] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144: Bootstrap starting.
I20260805 22:41:19.599664 5749 tablet_bootstrap.cc:654] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:19.599790 5750 tablet_bootstrap.cc:654] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:19.600021 5749 log.cc:824] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:19.600225 5751 tablet_bootstrap.cc:654] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:19.600333 5750 log.cc:824] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:19.600565 5751 log.cc:824] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:19.601498 5750 tablet_bootstrap.cc:492] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: No bootstrap required, opened a new log
I20260805 22:41:19.601570 5750 ts_tablet_manager.cc:1397] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:41:19.602593 5749 tablet_bootstrap.cc:492] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: No bootstrap required, opened a new log
I20260805 22:41:19.602641 5749 ts_tablet_manager.cc:1397] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260805 22:41:19.603449 5750 raft_consensus.cc:348] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 } } peers { permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 } } peers { permanent_uuid: "a9a8452e89a54a38877489f1fd177997" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 36371 } }
I20260805 22:41:19.603647 5750 raft_consensus.cc:374] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:19.603706 5750 raft_consensus.cc:729] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9a8452e89a54a38877489f1fd177997, State: Initialized, Role: FOLLOWER
I20260805 22:41:19.603827 5750 consensus_queue.cc:260] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 } } peers { permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 } } peers { permanent_uuid: "a9a8452e89a54a38877489f1fd177997" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 36371 } }
I20260805 22:41:19.603899 5751 tablet_bootstrap.cc:492] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144: No bootstrap required, opened a new log
I20260805 22:41:19.603962 5751 ts_tablet_manager.cc:1397] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260805 22:41:19.604116 5750 ts_tablet_manager.cc:1428] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:41:19.604274 5600 heartbeater.cc:503] Master 127.19.77.190:37609 was elected leader, sending a full tablet report...
I20260805 22:41:19.605379 5749 raft_consensus.cc:348] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 } } peers { permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 } } peers { permanent_uuid: "a9a8452e89a54a38877489f1fd177997" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 36371 } }
I20260805 22:41:19.605564 5749 raft_consensus.cc:374] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:19.605619 5749 raft_consensus.cc:729] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95e345618d4e452d8ea048998e30a90d, State: Initialized, Role: FOLLOWER
I20260805 22:41:19.605729 5749 consensus_queue.cc:260] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 } } peers { permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 } } peers { permanent_uuid: "a9a8452e89a54a38877489f1fd177997" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 36371 } }
I20260805 22:41:19.606011 5749 ts_tablet_manager.cc:1428] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260805 22:41:19.606108 5734 heartbeater.cc:503] Master 127.19.77.190:37609 was elected leader, sending a full tablet report...
I20260805 22:41:19.606771 5751 raft_consensus.cc:348] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 } } peers { permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 } } peers { permanent_uuid: "a9a8452e89a54a38877489f1fd177997" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 36371 } }
I20260805 22:41:19.606953 5751 raft_consensus.cc:374] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:19.607007 5751 raft_consensus.cc:729] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6e5f1475f24d8fbc000bff19c55144, State: Initialized, Role: FOLLOWER
I20260805 22:41:19.607126 5751 consensus_queue.cc:260] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 } } peers { permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 } } peers { permanent_uuid: "a9a8452e89a54a38877489f1fd177997" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 36371 } }
I20260805 22:41:19.607427 5751 ts_tablet_manager.cc:1428] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260805 22:41:19.607507 5463 heartbeater.cc:503] Master 127.19.77.190:37609 was elected leader, sending a full tablet report...
W20260805 22:41:19.684582 5601 tablet.cc:2369] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:41:19.716849 5755 raft_consensus.cc:482] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:19.717056 5755 raft_consensus.cc:504] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 } } peers { permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 } } peers { permanent_uuid: "a9a8452e89a54a38877489f1fd177997" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 36371 } }
I20260805 22:41:19.717518 5755 leader_election.cc:288] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95e345618d4e452d8ea048998e30a90d (127.19.77.131:37613), af6e5f1475f24d8fbc000bff19c55144 (127.19.77.129:45101)
I20260805 22:41:19.720499 5745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.717863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:43359 (local address 127.19.77.129:45101)
0805 22:41:19.717938 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.717940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.717950 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:19.717983 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.717984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.717996 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.718092 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:19.718265 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.718760 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.719749 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.720127 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.720223 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.720232 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.720383 (+ 151us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.720423 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260805 22:41:19.720499 5602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.717747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:45101 (local address 127.19.77.130:43359)
0805 22:41:19.717847 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:19.717860 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:19.717923 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:19.718103 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:19.718104 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:19.718106 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:19.718184 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.718186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.718855 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.718856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.719645 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.719648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.720221 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.720222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.720302 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.720305 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:19.720378 (+ 73us) client_negotiation.cc:240] Negotiation successful
0805 22:41:19.720423 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260805 22:41:19.720592 5748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.717838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:43507 (local address 127.19.77.131:37613)
0805 22:41:19.717907 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.717909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.718048 (+ 139us) server_negotiation.cc:407] Connection header received
0805 22:41:19.718136 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.718137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.718144 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.718225 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:19.718389 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.718844 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.719857 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.720223 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.720311 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.720319 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.720478 (+ 159us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.720518 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:41:19.720649 5758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.717774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:37613 (local address 127.19.77.130:43507)
0805 22:41:19.717956 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:19.717966 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:19.718059 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:19.718233 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:19.718235 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:19.718236 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:19.718315 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.718316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.718931 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.718932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.719753 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:19.719755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.720311 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.720312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:19.720398 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.720401 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:19.720472 (+ 71us) client_negotiation.cc:240] Negotiation successful
0805 22:41:19.720513 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":110,"threads_started":1}
I20260805 22:41:19.720878 5416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd738c682f64895b113994f0c6f6851" candidate_uuid: "a9a8452e89a54a38877489f1fd177997" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6e5f1475f24d8fbc000bff19c55144" is_pre_election: true
I20260805 22:41:19.721037 5416 raft_consensus.cc:2454] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a8452e89a54a38877489f1fd177997 in term 0.
I20260805 22:41:19.721007 5688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd738c682f64895b113994f0c6f6851" candidate_uuid: "a9a8452e89a54a38877489f1fd177997" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e345618d4e452d8ea048998e30a90d" is_pre_election: true
I20260805 22:41:19.721158 5688 raft_consensus.cc:2454] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9a8452e89a54a38877489f1fd177997 in term 0.
I20260805 22:41:19.721261 5482 leader_election.cc:302] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9a8452e89a54a38877489f1fd177997, af6e5f1475f24d8fbc000bff19c55144; no voters:
I20260805 22:41:19.721418 5755 raft_consensus.cc:2781] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:41:19.721510 5755 raft_consensus.cc:482] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:41:19.721554 5755 raft_consensus.cc:3037] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:19.722326 5755 raft_consensus.cc:504] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 } } peers { permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 } } peers { permanent_uuid: "a9a8452e89a54a38877489f1fd177997" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 36371 } }
I20260805 22:41:19.722494 5755 leader_election.cc:288] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [CANDIDATE]: Term 1 election: Requested vote from peers 95e345618d4e452d8ea048998e30a90d (127.19.77.131:37613), af6e5f1475f24d8fbc000bff19c55144 (127.19.77.129:45101)
I20260805 22:41:19.722637 5688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd738c682f64895b113994f0c6f6851" candidate_uuid: "a9a8452e89a54a38877489f1fd177997" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e345618d4e452d8ea048998e30a90d"
I20260805 22:41:19.722712 5416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd738c682f64895b113994f0c6f6851" candidate_uuid: "a9a8452e89a54a38877489f1fd177997" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6e5f1475f24d8fbc000bff19c55144"
I20260805 22:41:19.722744 5688 raft_consensus.cc:3037] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:19.722783 5416 raft_consensus.cc:3037] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:19.723467 5416 raft_consensus.cc:2454] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a8452e89a54a38877489f1fd177997 in term 1.
I20260805 22:41:19.723687 5688 raft_consensus.cc:2454] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9a8452e89a54a38877489f1fd177997 in term 1.
I20260805 22:41:19.723676 5482 leader_election.cc:302] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9a8452e89a54a38877489f1fd177997, af6e5f1475f24d8fbc000bff19c55144; no voters:
I20260805 22:41:19.723804 5755 raft_consensus.cc:2781] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:19.723979 5755 raft_consensus.cc:686] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 1 LEADER]: Becoming Leader. State: Replica: a9a8452e89a54a38877489f1fd177997, State: Running, Role: LEADER
I20260805 22:41:19.724103 5755 consensus_queue.cc:237] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 } } peers { permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 } } peers { permanent_uuid: "a9a8452e89a54a38877489f1fd177997" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 36371 } }
I20260805 22:41:19.724972 5268 catalog_manager.cc:5495] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9a8452e89a54a38877489f1fd177997 (127.19.77.130). New cstate: current_term: 1 leader_uuid: "a9a8452e89a54a38877489f1fd177997" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9a8452e89a54a38877489f1fd177997" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 36371 } health_report { overall_health: HEALTHY } } }
I20260805 22:41:19.743012 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.740715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60572 (local address 127.19.77.130:36371)
0805 22:41:19.740794 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:19.740796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:19.740806 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:19.740858 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:19.740859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:19.740878 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:19.740943 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:19.741051 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.741515 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.742259 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:19.742447 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:19.742499 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:19.742644 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:19.742751 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:19.742816 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:19.742850 (+ 34us) server_negotiation.cc:299] Negotiation successful
0805 22:41:19.742866 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260805 22:41:19.745154 5416 raft_consensus.cc:1261] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144 [term 1 FOLLOWER]: Refusing update from remote peer a9a8452e89a54a38877489f1fd177997: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:19.745154 5688 raft_consensus.cc:1261] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d [term 1 FOLLOWER]: Refusing update from remote peer a9a8452e89a54a38877489f1fd177997: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:19.745579 5759 consensus_queue.cc:1035] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95e345618d4e452d8ea048998e30a90d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 37613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:19.745857 5755 consensus_queue.cc:1035] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6e5f1475f24d8fbc000bff19c55144" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 45101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:19.748338 5763 mvcc.cc:205] Tried to move back new op lower bound from 7315331808232779776 to 7315331808150573056. Current Snapshot: MvccSnapshot[applied={T|T < 7315331808232779776}]
I20260805 22:41:19.749756 5764 mvcc.cc:205] Tried to move back new op lower bound from 7315331808232779776 to 7315331808150573056. Current Snapshot: MvccSnapshot[applied={T|T < 7315331808232779776}]
I20260805 22:41:19.750914 5267 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:19.751019 5267 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:19.751873 5267 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 209861416ea54e4b999e7f44ecac9d0b: Sending DeleteTablet for 3 replicas of tablet 9fd738c682f64895b113994f0c6f6851
I20260805 22:41:19.752274 5395 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fd738c682f64895b113994f0c6f6851 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:19 UTC) from {username='slave'} at 127.0.0.1:41052
I20260805 22:41:19.752302 5667 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fd738c682f64895b113994f0c6f6851 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:19 UTC) from {username='slave'} at 127.0.0.1:46888
I20260805 22:41:19.752508 5774 tablet_replica.cc:330] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144: stopping tablet replica
I20260805 22:41:19.752556 5775 tablet_replica.cc:330] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: stopping tablet replica
I20260805 22:41:19.752626 5774 raft_consensus.cc:2229] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:41:19.752638 5775 raft_consensus.cc:2229] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:41:19.752655 5531 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fd738c682f64895b113994f0c6f6851 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:19 UTC) from {username='slave'} at 127.0.0.1:60558
I20260805 22:41:19.752727 5775 raft_consensus.cc:2258] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:19.752727 5774 raft_consensus.cc:2258] T 9fd738c682f64895b113994f0c6f6851 P af6e5f1475f24d8fbc000bff19c55144 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:19.753186 5775 ts_tablet_manager.cc:1905] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:19.753518 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 5330
I20260805 22:41:19.755764 5775 ts_tablet_manager.cc:1918] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:19.755823 5775 log.cc:1196] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/9fd738c682f64895b113994f0c6f6851
I20260805 22:41:19.756011 5775 ts_tablet_manager.cc:1939] T 9fd738c682f64895b113994f0c6f6851 P 95e345618d4e452d8ea048998e30a90d: Deleting consensus metadata
I20260805 22:41:19.756707 5252 catalog_manager.cc:4841] TS 95e345618d4e452d8ea048998e30a90d (127.19.77.131:37613): tablet 9fd738c682f64895b113994f0c6f6851 (table test-table [id=06e3c660c52344d1bca046d1f6bdfad9]) successfully deleted
I20260805 22:41:19.759333 5776 tablet_replica.cc:330] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: stopping tablet replica
I20260805 22:41:19.759497 5776 raft_consensus.cc:2229] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:41:19.759622 5776 raft_consensus.cc:2258] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:19.760115 5776 ts_tablet_manager.cc:1905] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:19.761798 5776 ts_tablet_manager.cc:1918] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:19.761900 5776 log.cc:1196] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/9fd738c682f64895b113994f0c6f6851
I20260805 22:41:19.762212 5776 ts_tablet_manager.cc:1939] T 9fd738c682f64895b113994f0c6f6851 P a9a8452e89a54a38877489f1fd177997: Deleting consensus metadata
W20260805 22:41:19.762282 5253 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:45101 (error 108)
I20260805 22:41:19.762775 5253 catalog_manager.cc:4841] TS a9a8452e89a54a38877489f1fd177997 (127.19.77.130:36371): tablet 9fd738c682f64895b113994f0c6f6851 (table test-table [id=06e3c660c52344d1bca046d1f6bdfad9]) successfully deleted
I20260805 22:41:19.762907 5744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:19.762709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:45101 (local address 127.0.0.1:41056)
0805 22:41:19.762795 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:19.762862 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:45101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260805 22:41:19.763022 5253 catalog_manager.cc:4584] TS af6e5f1475f24d8fbc000bff19c55144 (127.19.77.129:45101): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9fd738c682f64895b113994f0c6f6851: Network error: Client connection negotiation failed: client connection to 127.19.77.129:45101: connect: Connection refused (error 111)
I20260805 22:41:19.763386 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 5466
I20260805 22:41:19.770087 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 5603
I20260805 22:41:19.776153 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 5235
2026-08-05T22:41:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (791 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:19 dist-test-slave-chsk krb5kdc[5780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:19 dist-test-slave-chsk krb5kdc[5780](info): set up 2 sockets
Aug 05 22:41:19 dist-test-slave-chsk krb5kdc[5780](info): commencing operation
krb5kdc: starting...
W20260805 22:41:20.834635 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:20 dist-test-slave-chsk krb5kdc[5780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:20.971072 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34637
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:34637
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:21.057623 5794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:21.057890 5794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:21.057936 5794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:21.059242 5794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:21.059324 5794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:21.059350 5794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:21.059378 5794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:21.059407 5794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:21.061190 5794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:34637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:21.061512 5794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:21.061774 5794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:21.066975 5799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:21.066977 5802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:21.066980 5800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:21.067168 5794 server_base.cc:1034] running on GCE node
I20260805 22:41:21.067516 5794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:21.067862 5794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:21.069067 5794 hybrid_clock.cc:648] HybridClock initialized: now 1785969681069054 us; error 30 us; skew 500 ppm
Aug 05 22:41:21 dist-test-slave-chsk krb5kdc[5780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969681, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:21.071871 5794 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:21.072422 5794 webserver.cc:460] Webserver started at http://127.19.77.190:44295/ using document root <none> and password file <none>
I20260805 22:41:21.072670 5794 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:21.072746 5794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:21.072903 5794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:21.074054 5794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "2912ca363bbd4b29b9cb7f219c19247d"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "a7b82b1b361e01b0b815ba360c6c75df"
server_key_iv: "49b59d4700e21525cb9a2baa5a96b23a"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.074456 5794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "2912ca363bbd4b29b9cb7f219c19247d"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "a7b82b1b361e01b0b815ba360c6c75df"
server_key_iv: "49b59d4700e21525cb9a2baa5a96b23a"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.076056 5794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:21.076985 5809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:21.077180 5794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:21.077294 5794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "2912ca363bbd4b29b9cb7f219c19247d"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "a7b82b1b361e01b0b815ba360c6c75df"
server_key_iv: "49b59d4700e21525cb9a2baa5a96b23a"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.077380 5794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:21.102527 5794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:21.105096 5794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:21.105268 5794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:21.109603 5794 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:34637
I20260805 22:41:21.109647 5861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:34637 every 8 connection(s)
I20260805 22:41:21.110072 5794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:21.111083 5862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:21.113621 5862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d: Bootstrap starting.
I20260805 22:41:21.114306 5862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:21.114630 5862 log.cc:824] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:21.115509 5862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d: No bootstrap required, opened a new log
I20260805 22:41:21.117290 5862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2912ca363bbd4b29b9cb7f219c19247d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34637 } }
I20260805 22:41:21.117479 5862 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:21.117532 5862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2912ca363bbd4b29b9cb7f219c19247d, State: Initialized, Role: FOLLOWER
I20260805 22:41:21.117581 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 5794
I20260805 22:41:21.117729 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:21.117750 5862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2912ca363bbd4b29b9cb7f219c19247d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34637 } }
I20260805 22:41:21.117846 5862 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:21.117887 5862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:21.117940 5862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:21.117959 19766 external_mini_cluster.cc:1428] Setting key 8d9201311c342b9a923f901c26465ff5
I20260805 22:41:21.118806 5862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2912ca363bbd4b29b9cb7f219c19247d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34637 } }
I20260805 22:41:21.119019 5862 leader_election.cc:302] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2912ca363bbd4b29b9cb7f219c19247d; no voters:
I20260805 22:41:21.119266 5862 leader_election.cc:288] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:21.119292 5867 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:21.119426 5867 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [term 1 LEADER]: Becoming Leader. State: Replica: 2912ca363bbd4b29b9cb7f219c19247d, State: Running, Role: LEADER
I20260805 22:41:21.119582 5862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:21.119607 5867 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2912ca363bbd4b29b9cb7f219c19247d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34637 } }
I20260805 22:41:21.120124 5869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2912ca363bbd4b29b9cb7f219c19247d. Latest consensus state: current_term: 1 leader_uuid: "2912ca363bbd4b29b9cb7f219c19247d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2912ca363bbd4b29b9cb7f219c19247d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34637 } } }
I20260805 22:41:21.120229 5869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:21.120514 5868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2912ca363bbd4b29b9cb7f219c19247d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2912ca363bbd4b29b9cb7f219c19247d" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34637 } } }
I20260805 22:41:21.120951 5868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:21.120930 5875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:21.121695 5875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:21.123515 5875 catalog_manager.cc:1347] Generated new cluster ID: 6ffcad2044e544eaad3e79f3fe94ec48
I20260805 22:41:21.123584 5875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:41:21 dist-test-slave-chsk krb5kdc[5780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:21.131057 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.118892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45284 (local address 127.19.77.190:34637)
0805 22:41:21.119127 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.119140 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.119469 (+ 329us) server_negotiation.cc:407] Connection header received
0805 22:41:21.119600 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.119608 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.119677 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.119797 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:21.120775 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.122426 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.123543 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.124091 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.124229 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.126825 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:21.126830 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:21.126831 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:21.126845 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:21.129243 (+ 2398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:21.129678 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:21.129684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:21.129684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:21.129817 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:21.130061 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:21.130062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:21.130062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:21.130351 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:21.130539 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.130643 (+ 104us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.130808 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
I20260805 22:41:21.150228 5875 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:21.150992 5875 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:21.154865 5875 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d: Generated new TSK 0
I20260805 22:41:21.155088 5875 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:41:21.194684 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34637
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:21.284272 5888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:21.284544 5888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:21.284593 5888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:21.285945 5888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:21.286036 5888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:21.286087 5888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:41:21.287810 5888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:21.288134 5888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:21.288419 5888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:21.293982 5896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:21.293983 5893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:21.293980 5894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:21.294263 5888 server_base.cc:1034] running on GCE node
I20260805 22:41:21.294554 5888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:21.294835 5888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:21.296054 5888 hybrid_clock.cc:648] HybridClock initialized: now 1785969681296019 us; error 53 us; skew 500 ppm
Aug 05 22:41:21 dist-test-slave-chsk krb5kdc[5780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969681, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:21.298918 5888 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:41:21.299504 5888 webserver.cc:460] Webserver started at http://127.19.77.129:38575/ using document root <none> and password file <none>
I20260805 22:41:21.299801 5888 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:21.299882 5888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:21.300065 5888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:21.301302 5888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "a46d4b1e511847af95a4970828744280"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "ae9bed9ca62e189fe434c4cde0ca85c5"
server_key_iv: "9da19bec6aa45407f6ed9d511b8c0311"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.301736 5888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "a46d4b1e511847af95a4970828744280"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "ae9bed9ca62e189fe434c4cde0ca85c5"
server_key_iv: "9da19bec6aa45407f6ed9d511b8c0311"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.303493 5888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260805 22:41:21.304667 5903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:21.305102 5888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:21.305244 5888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "a46d4b1e511847af95a4970828744280"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "ae9bed9ca62e189fe434c4cde0ca85c5"
server_key_iv: "9da19bec6aa45407f6ed9d511b8c0311"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.305359 5888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:21.324493 5888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:21.327118 5888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:21.327435 5888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:21.327752 5888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:21.328109 5888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:21.328171 5888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:21.328217 5888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:21.328243 5888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:21.335054 5888 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:36455
I20260805 22:41:21.335121 6018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:36455 every 8 connection(s)
I20260805 22:41:21.335510 5888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:41:21.341961 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 5888
I20260805 22:41:21.342132 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:41:21.342397 19766 external_mini_cluster.cc:1428] Setting key 84b1c7b68c0432b5ce1eeee7cae0afef
Aug 05 22:41:21 dist-test-slave-chsk krb5kdc[5780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969681, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:21.349234 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.336337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:49001 (local address 127.19.77.190:34637)
0805 22:41:21.336384 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.336387 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.336646 (+ 259us) server_negotiation.cc:407] Connection header received
0805 22:41:21.337492 (+ 846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.337494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.337563 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.337623 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:21.339198 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.339728 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.341344 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.341714 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.341791 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.345209 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:21.345211 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:21.345212 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:21.345223 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:21.347384 (+ 2161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:21.347988 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:21.347990 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:21.347991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:21.348067 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:21.348448 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:21.348449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:21.348450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:21.348591 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:21.348680 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.349013 (+ 333us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.349135 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:41:21.349464 6021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.336323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34637 (local address 127.19.77.129:49001)
0805 22:41:21.336496 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:21.336536 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:21.337303 (+ 767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:21.337743 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:21.337748 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:21.338673 (+ 925us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:21.339052 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.339061 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.339968 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.339970 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.341189 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.341195 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.341883 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.341884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.342092 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.342844 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:21.342856 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:21.345055 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:21.347507 (+ 2452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:21.347520 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:21.347523 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:21.347902 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:21.348174 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:21.348175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:21.348175 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:21.348356 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:21.348682 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:21.348691 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:21.348863 (+ 172us) client_negotiation.cc:769] Sending connection context
0805 22:41:21.348989 (+ 126us) client_negotiation.cc:240] Negotiation successful
0805 22:41:21.349184 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
I20260805 22:41:21.350003 6019 heartbeater.cc:347] Connected to a master server at 127.19.77.190:34637
I20260805 22:41:21.350148 6019 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:21.350415 6019 heartbeater.cc:511] Master 127.19.77.190:34637 requested a full tablet report, sending...
I20260805 22:41:21.351047 5826 ts_manager.cc:194] Registered new tserver with Master: a46d4b1e511847af95a4970828744280 (127.19.77.129:36455)
I20260805 22:41:21.351755 5826 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:49001
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:41:21.374086 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34637
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:21.468799 6024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:21.469074 6024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:21.469105 6024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:21.470551 6024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:21.470606 6024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:21.470640 6024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:41:21.472357 6024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:21.472618 6024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:21.472829 6024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:21.478690 6032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:21.478636 6029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:21.478670 6024 server_base.cc:1034] running on GCE node
W20260805 22:41:21.478636 6030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:21.479290 6024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:21.479614 6024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:21.480815 6024 hybrid_clock.cc:648] HybridClock initialized: now 1785969681480774 us; error 81 us; skew 500 ppm
Aug 05 22:41:21 dist-test-slave-chsk krb5kdc[5780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969681, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:21.483810 6024 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:41:21.484390 6024 webserver.cc:460] Webserver started at http://127.19.77.130:42601/ using document root <none> and password file <none>
I20260805 22:41:21.484685 6024 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:21.484763 6024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:21.484938 6024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:21.486120 6024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "23c6ac7f3d3346c9a406dc6441640044"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "9ca023a486e884a5216b1465b112673b"
server_key_iv: "84dd47b528379c1025e84c1d2b83b05a"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.486541 6024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "23c6ac7f3d3346c9a406dc6441640044"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "9ca023a486e884a5216b1465b112673b"
server_key_iv: "84dd47b528379c1025e84c1d2b83b05a"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.488873 6024 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260805 22:41:21.489835 6039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:21.490065 6024 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:21.490177 6024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "23c6ac7f3d3346c9a406dc6441640044"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "9ca023a486e884a5216b1465b112673b"
server_key_iv: "84dd47b528379c1025e84c1d2b83b05a"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.490288 6024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:21.503769 6024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:21.506356 6024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:21.506649 6024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:21.506923 6024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:21.507339 6024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:21.507400 6024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:21.507442 6024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:21.507470 6024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:21.514051 6024 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:37901
I20260805 22:41:21.514103 6158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:37901 every 8 connection(s)
I20260805 22:41:21.514474 6024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:41:21.521080 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 6024
I20260805 22:41:21.521266 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:41:21.521507 19766 external_mini_cluster.cc:1428] Setting key b68a098eacc2ae8f0b413e4f9b384d11
Aug 05 22:41:21 dist-test-slave-chsk krb5kdc[5780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969681, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:21.525993 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.515426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:42589 (local address 127.19.77.190:34637)
0805 22:41:21.515499 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.515501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.515723 (+ 222us) server_negotiation.cc:407] Connection header received
0805 22:41:21.516317 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.516318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.516331 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.516392 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:21.517479 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.518010 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.519243 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.519460 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.519556 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.522855 (+ 3299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:21.522857 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:21.522857 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:21.522867 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:21.524349 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:21.524867 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:21.524869 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:21.524869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:21.524937 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:21.525244 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:21.525245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:21.525246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:21.525381 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:21.525466 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.525794 (+ 328us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.525893 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260805 22:41:21.526209 6162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.515410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34637 (local address 127.19.77.130:42589)
0805 22:41:21.515579 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:21.515629 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:21.516198 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:21.516463 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:21.516468 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:21.517143 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:21.517363 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.517368 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.518136 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.518137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.519060 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.519064 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.519573 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.519574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.519754 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.520421 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:21.520430 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:21.522733 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:21.524471 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:21.524482 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:21.524485 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:21.524766 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:21.525023 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:21.525024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:21.525024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:21.525167 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:21.525470 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:21.525480 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:21.525643 (+ 163us) client_negotiation.cc:769] Sending connection context
0805 22:41:21.525759 (+ 116us) client_negotiation.cc:240] Negotiation successful
0805 22:41:21.525949 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
I20260805 22:41:21.526897 6160 heartbeater.cc:347] Connected to a master server at 127.19.77.190:34637
I20260805 22:41:21.527086 6160 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:21.527359 6160 heartbeater.cc:511] Master 127.19.77.190:34637 requested a full tablet report, sending...
I20260805 22:41:21.527846 5826 ts_manager.cc:194] Registered new tserver with Master: 23c6ac7f3d3346c9a406dc6441640044 (127.19.77.130:37901)
I20260805 22:41:21.528266 5826 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:42589
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:41:21.554126 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34637
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:36423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:21.651612 6165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:21.651872 6165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:21.651928 6165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:21.653282 6165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:21.653335 6165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:21.653367 6165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:41:21.655301 6165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:36423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:34637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:21.655606 6165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:21.655838 6165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:21.661389 6171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:21.661423 6173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:21.661393 6170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:21.661427 6165 server_base.cc:1034] running on GCE node
I20260805 22:41:21.661935 6165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:21.662256 6165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:21.663446 6165 hybrid_clock.cc:648] HybridClock initialized: now 1785969681663445 us; error 41 us; skew 500 ppm
Aug 05 22:41:21 dist-test-slave-chsk krb5kdc[5780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969681, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:21.670850 6165 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:41:21.671497 6165 webserver.cc:460] Webserver started at http://127.19.77.131:38821/ using document root <none> and password file <none>
I20260805 22:41:21.671777 6165 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:21.671834 6165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:21.671943 6165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:21.673182 6165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "b7ab18915c0b4a51a9ae3a22d41dad54"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "397a70ba80130660cca68122dbe2f2ea"
server_key_iv: "4c9abb2fc43c193f3f5086c6aab18ef3"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.673662 6165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "b7ab18915c0b4a51a9ae3a22d41dad54"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "397a70ba80130660cca68122dbe2f2ea"
server_key_iv: "4c9abb2fc43c193f3f5086c6aab18ef3"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.675318 6165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:21.676421 6180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:21.676681 6165 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:21.676790 6165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "b7ab18915c0b4a51a9ae3a22d41dad54"
format_stamp: "Formatted at 2026-08-05 22:41:21 on dist-test-slave-chsk"
server_key: "397a70ba80130660cca68122dbe2f2ea"
server_key_iv: "4c9abb2fc43c193f3f5086c6aab18ef3"
server_key_version: "encryptionkey@0"
I20260805 22:41:21.676882 6165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:21.686475 6165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:21.688846 6165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:21.689038 6165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:21.689312 6165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:21.689653 6165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:21.689688 6165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:21.689713 6165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:21.689764 6165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:21.696401 6165 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:33015
I20260805 22:41:21.696455 6298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:33015 every 8 connection(s)
I20260805 22:41:21.696816 6165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:41:21.700987 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 6165
I20260805 22:41:21.701093 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:41:21.701308 19766 external_mini_cluster.cc:1428] Setting key 13505a90aa392c4ae68cab08f1c8d8c0
Aug 05 22:41:21 dist-test-slave-chsk krb5kdc[5780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969681, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:21.707267 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.697666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:49165 (local address 127.19.77.190:34637)
0805 22:41:21.697729 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.697750 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.697949 (+ 199us) server_negotiation.cc:407] Connection header received
0805 22:41:21.698525 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.698526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.698540 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.698607 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:21.699702 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.700273 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.701371 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.701625 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.701695 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.704412 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:21.704414 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:21.704414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:21.704422 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:21.705798 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:21.706277 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:21.706278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:21.706278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:21.706330 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:21.706594 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:21.706595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:21.706596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:21.706727 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:21.706802 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.707053 (+ 251us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.707132 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:41:21.707538 6301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.697624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:34637 (local address 127.19.77.131:49165)
0805 22:41:21.697826 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:21.697864 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:21.698393 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:21.698679 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:21.698683 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:21.699375 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:21.699589 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.699594 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.700387 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.700388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.701277 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.701280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.701729 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.701730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.701917 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.702699 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:21.702707 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:21.704304 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:21.705887 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:21.705895 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:21.705897 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:21.706204 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:21.706392 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:21.706392 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:21.706393 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:21.706501 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:21.706793 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:21.706798 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:21.706931 (+ 133us) client_negotiation.cc:769] Sending connection context
0805 22:41:21.707019 (+ 88us) client_negotiation.cc:240] Negotiation successful
0805 22:41:21.707248 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":93,"threads_started":1}
I20260805 22:41:21.708114 6299 heartbeater.cc:347] Connected to a master server at 127.19.77.190:34637
I20260805 22:41:21.708271 6299 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:21.708446 6299 heartbeater.cc:511] Master 127.19.77.190:34637 requested a full tablet report, sending...
I20260805 22:41:21.708858 5826 ts_manager.cc:194] Registered new tserver with Master: b7ab18915c0b4a51a9ae3a22d41dad54 (127.19.77.131:33015)
I20260805 22:41:21.709340 5826 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:49165
I20260805 22:41:21.713634 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:41:21.722149 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.715115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45286 (local address 127.19.77.190:34637)
0805 22:41:21.715216 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.715218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.715354 (+ 136us) server_negotiation.cc:407] Connection header received
0805 22:41:21.715400 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.715400 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.715410 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.715467 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:21.716034 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.716531 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.717258 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.717446 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.717509 (+ 63us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.718993 (+ 1484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:21.718994 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:21.718994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:21.719001 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:21.720834 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:21.721295 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:21.721296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:21.721296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:21.721394 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:21.721600 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:21.721601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:21.721601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:21.721747 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:21.721827 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.721966 (+ 139us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.722025 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 22:41:21.724637 5826 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:41:21.726307 5826 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:41:21.734211 6310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.729242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:37901 (local address 127.0.0.1:48712)
0805 22:41:21.730156 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:21.730166 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:21.730212 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:21.730414 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:21.730415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:21.730418 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:21.730478 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.730481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.731891 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.731892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.732792 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.732795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.733851 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.733852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.733948 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.733963 (+ 15us) client_negotiation.cc:769] Sending connection context
0805 22:41:21.734033 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:41:21.734115 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"mutex_wait_us":1,"thread_start_us":99,"threads_started":1}
I20260805 22:41:21.734783 6313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.729402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48712 (local address 127.19.77.130:37901)
0805 22:41:21.729783 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.729791 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.730273 (+ 482us) server_negotiation.cc:407] Connection header received
0805 22:41:21.730319 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.730322 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.730338 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.730403 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:21.730555 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.731758 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.732905 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.733676 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.733750 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.733812 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.734635 (+ 823us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.734692 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":137,"threads_started":1}
I20260805 22:41:21.734944 6312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.729249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:36455 (local address 127.0.0.1:42602)
0805 22:41:21.729908 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:21.729973 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:21.730057 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:21.730315 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:21.730319 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:21.730322 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:21.730476 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.730479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.731887 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.731888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.733467 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.733469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.734585 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.734586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.734669 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.734673 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:41:21.734721 (+ 48us) client_negotiation.cc:240] Negotiation successful
0805 22:41:21.734767 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":71,"threads_started":1}
I20260805 22:41:21.735311 6315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.729729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42602 (local address 127.19.77.129:36455)
0805 22:41:21.729919 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.729923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.730074 (+ 151us) server_negotiation.cc:407] Connection header received
0805 22:41:21.730167 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.730170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.730188 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.730267 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:21.730647 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.731756 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.733564 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.734420 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.734489 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.734547 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.735170 (+ 623us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.735225 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":88,"threads_started":1}
I20260805 22:41:21.736120 5953 tablet_service.cc:1467] Processing CreateTablet for tablet 37852056fd4b418a86ae28d26eaa786c (DEFAULT_TABLE table=test-table [id=f5ff58d49c204b4e896977127b3e894e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:21.736130 6091 tablet_service.cc:1467] Processing CreateTablet for tablet 37852056fd4b418a86ae28d26eaa786c (DEFAULT_TABLE table=test-table [id=f5ff58d49c204b4e896977127b3e894e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:21.736510 5953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37852056fd4b418a86ae28d26eaa786c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:21.736512 6091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37852056fd4b418a86ae28d26eaa786c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:21.737924 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.729478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33015 (local address 127.0.0.1:37932)
0805 22:41:21.733208 (+ 3730us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:21.733220 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:21.733283 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:21.733624 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:21.733625 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:21.733627 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:21.733680 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.733681 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.735501 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.735502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.736589 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.736593 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.737634 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.737635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.737702 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.737708 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:41:21.737778 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:41:21.737828 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3701,"thread_start_us":80,"threads_started":1}
I20260805 22:41:21.737946 6314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.729616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37932 (local address 127.19.77.131:33015)
0805 22:41:21.729834 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.729839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.733353 (+ 3514us) server_negotiation.cc:407] Connection header received
0805 22:41:21.733407 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.733410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.733427 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.733518 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:21.733755 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.735372 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.736699 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.737524 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.737605 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.737663 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.737810 (+ 147us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.737859 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":107,"threads_started":1}
I20260805 22:41:21.738718 6231 tablet_service.cc:1467] Processing CreateTablet for tablet 37852056fd4b418a86ae28d26eaa786c (DEFAULT_TABLE table=test-table [id=f5ff58d49c204b4e896977127b3e894e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:21.739117 6231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37852056fd4b418a86ae28d26eaa786c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:21.739916 6316 tablet_bootstrap.cc:492] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280: Bootstrap starting.
I20260805 22:41:21.740660 6317 tablet_bootstrap.cc:492] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: Bootstrap starting.
I20260805 22:41:21.741025 6316 tablet_bootstrap.cc:654] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:21.741375 6317 tablet_bootstrap.cc:654] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:21.741641 6316 log.cc:824] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:21.742002 6317 log.cc:824] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:21.742745 6316 tablet_bootstrap.cc:492] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280: No bootstrap required, opened a new log
I20260805 22:41:21.742745 6317 tablet_bootstrap.cc:492] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: No bootstrap required, opened a new log
I20260805 22:41:21.742820 6317 ts_tablet_manager.cc:1397] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:41:21.742820 6316 ts_tablet_manager.cc:1397] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:41:21.742897 6320 tablet_bootstrap.cc:492] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: Bootstrap starting.
I20260805 22:41:21.743577 6320 tablet_bootstrap.cc:654] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:21.744064 6320 log.cc:824] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:21.744813 6320 tablet_bootstrap.cc:492] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: No bootstrap required, opened a new log
I20260805 22:41:21.744901 6320 ts_tablet_manager.cc:1397] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260805 22:41:21.744989 6317 raft_consensus.cc:348] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23c6ac7f3d3346c9a406dc6441640044" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37901 } } peers { permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 } } peers { permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 } }
I20260805 22:41:21.744989 6316 raft_consensus.cc:348] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23c6ac7f3d3346c9a406dc6441640044" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37901 } } peers { permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 } } peers { permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 } }
I20260805 22:41:21.745200 6316 raft_consensus.cc:374] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:21.745200 6317 raft_consensus.cc:374] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:21.745240 6316 raft_consensus.cc:729] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46d4b1e511847af95a4970828744280, State: Initialized, Role: FOLLOWER
I20260805 22:41:21.745240 6317 raft_consensus.cc:729] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23c6ac7f3d3346c9a406dc6441640044, State: Initialized, Role: FOLLOWER
I20260805 22:41:21.745375 6317 consensus_queue.cc:260] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23c6ac7f3d3346c9a406dc6441640044" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37901 } } peers { permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 } } peers { permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 } }
I20260805 22:41:21.745391 6316 consensus_queue.cc:260] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23c6ac7f3d3346c9a406dc6441640044" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37901 } } peers { permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 } } peers { permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 } }
I20260805 22:41:21.745693 6317 ts_tablet_manager.cc:1428] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:41:21.745725 6160 heartbeater.cc:503] Master 127.19.77.190:34637 was elected leader, sending a full tablet report...
I20260805 22:41:21.745996 6316 ts_tablet_manager.cc:1428] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:41:21.746167 6019 heartbeater.cc:503] Master 127.19.77.190:34637 was elected leader, sending a full tablet report...
I20260805 22:41:21.747169 6320 raft_consensus.cc:348] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23c6ac7f3d3346c9a406dc6441640044" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37901 } } peers { permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 } } peers { permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 } }
I20260805 22:41:21.747386 6320 raft_consensus.cc:374] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:21.747437 6320 raft_consensus.cc:729] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab18915c0b4a51a9ae3a22d41dad54, State: Initialized, Role: FOLLOWER
I20260805 22:41:21.747567 6320 consensus_queue.cc:260] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23c6ac7f3d3346c9a406dc6441640044" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37901 } } peers { permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 } } peers { permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 } }
I20260805 22:41:21.747849 6320 ts_tablet_manager.cc:1428] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260805 22:41:21.747885 6299 heartbeater.cc:503] Master 127.19.77.190:34637 was elected leader, sending a full tablet report...
W20260805 22:41:21.765328 6161 tablet.cc:2369] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:41:21.836367 6020 tablet.cc:2369] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:41:21.876961 6323 raft_consensus.cc:482] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:21.877103 6323 raft_consensus.cc:504] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23c6ac7f3d3346c9a406dc6441640044" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37901 } } peers { permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 } } peers { permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 } }
I20260805 22:41:21.877530 6323 leader_election.cc:288] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a46d4b1e511847af95a4970828744280 (127.19.77.129:36455), b7ab18915c0b4a51a9ae3a22d41dad54 (127.19.77.131:33015)
I20260805 22:41:21.881026 6315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.877834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:38969 (local address 127.19.77.129:36455)
0805 22:41:21.877896 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.877898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.877911 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:41:21.877947 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.877948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.877962 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.878095 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:21.878310 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.878892 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.880089 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.880642 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.880716 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.880726 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.880904 (+ 178us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.880952 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260805 22:41:21.881026 6162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.877727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:36455 (local address 127.19.77.130:38969)
0805 22:41:21.877808 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:21.877821 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:21.877871 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:21.878117 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:21.878118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:21.878120 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:21.878219 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.878222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.878993 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.878994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.879943 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.879946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.880725 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.880726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.880818 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.880823 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:41:21.880879 (+ 56us) client_negotiation.cc:240] Negotiation successful
0805 22:41:21.880935 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260805 22:41:21.881119 6325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.877891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33015 (local address 127.19.77.130:34507)
0805 22:41:21.878151 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:21.878161 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:21.878218 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:21.878356 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:21.878357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:21.878359 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:21.878429 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.878431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.879081 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.879082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.880058 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:21.880061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.880771 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.880772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:21.880882 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.880886 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:41:21.880963 (+ 77us) client_negotiation.cc:240] Negotiation successful
0805 22:41:21.880997 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":135,"threads_started":1}
I20260805 22:41:21.881119 6314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.878047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:34507 (local address 127.19.77.131:33015)
0805 22:41:21.878096 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.878098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.878232 (+ 134us) server_negotiation.cc:407] Connection header received
0805 22:41:21.878275 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.878276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.878286 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.878341 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:21.878506 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.878996 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.880164 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.880696 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.880769 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.880779 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.880976 (+ 197us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.881020 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:41:21.881564 6252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37852056fd4b418a86ae28d26eaa786c" candidate_uuid: "23c6ac7f3d3346c9a406dc6441640044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" is_pre_election: true
I20260805 22:41:21.881760 6252 raft_consensus.cc:2454] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23c6ac7f3d3346c9a406dc6441640044 in term 0.
I20260805 22:41:21.882067 6041 leader_election.cc:302] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23c6ac7f3d3346c9a406dc6441640044, b7ab18915c0b4a51a9ae3a22d41dad54; no voters:
I20260805 22:41:21.882042 5973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37852056fd4b418a86ae28d26eaa786c" candidate_uuid: "23c6ac7f3d3346c9a406dc6441640044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46d4b1e511847af95a4970828744280" is_pre_election: true
I20260805 22:41:21.882197 5973 raft_consensus.cc:2454] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23c6ac7f3d3346c9a406dc6441640044 in term 0.
I20260805 22:41:21.882231 6323 raft_consensus.cc:2781] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:41:21.882329 6323 raft_consensus.cc:482] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:41:21.882372 6323 raft_consensus.cc:3037] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:21.883188 6323 raft_consensus.cc:504] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23c6ac7f3d3346c9a406dc6441640044" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37901 } } peers { permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 } } peers { permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 } }
I20260805 22:41:21.883332 6323 leader_election.cc:288] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [CANDIDATE]: Term 1 election: Requested vote from peers a46d4b1e511847af95a4970828744280 (127.19.77.129:36455), b7ab18915c0b4a51a9ae3a22d41dad54 (127.19.77.131:33015)
I20260805 22:41:21.883517 6252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37852056fd4b418a86ae28d26eaa786c" candidate_uuid: "23c6ac7f3d3346c9a406dc6441640044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54"
I20260805 22:41:21.883527 5973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37852056fd4b418a86ae28d26eaa786c" candidate_uuid: "23c6ac7f3d3346c9a406dc6441640044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46d4b1e511847af95a4970828744280"
I20260805 22:41:21.883606 5973 raft_consensus.cc:3037] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:21.883634 6252 raft_consensus.cc:3037] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:21.884366 5973 raft_consensus.cc:2454] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23c6ac7f3d3346c9a406dc6441640044 in term 1.
I20260805 22:41:21.884523 6252 raft_consensus.cc:2454] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23c6ac7f3d3346c9a406dc6441640044 in term 1.
I20260805 22:41:21.884546 6041 leader_election.cc:302] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23c6ac7f3d3346c9a406dc6441640044, a46d4b1e511847af95a4970828744280; no voters:
I20260805 22:41:21.884687 6323 raft_consensus.cc:2781] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:21.884859 6323 raft_consensus.cc:686] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 1 LEADER]: Becoming Leader. State: Replica: 23c6ac7f3d3346c9a406dc6441640044, State: Running, Role: LEADER
I20260805 22:41:21.884976 6323 consensus_queue.cc:237] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23c6ac7f3d3346c9a406dc6441640044" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37901 } } peers { permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 } } peers { permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 } }
I20260805 22:41:21.885872 5825 catalog_manager.cc:5495] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23c6ac7f3d3346c9a406dc6441640044 (127.19.77.130). New cstate: current_term: 1 leader_uuid: "23c6ac7f3d3346c9a406dc6441640044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23c6ac7f3d3346c9a406dc6441640044" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 } health_report { overall_health: UNKNOWN } } }
I20260805 22:41:21.922176 6313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.919278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48720 (local address 127.19.77.130:37901)
0805 22:41:21.919371 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:21.919373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:21.919381 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:41:21.919422 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:21.919423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:21.919444 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:21.919522 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:21.919749 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.920368 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.921286 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:21.921542 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:21.921610 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:21.921758 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:21.921850 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:21.921925 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:21.922062 (+ 137us) server_negotiation.cc:299] Negotiation successful
0805 22:41:21.922074 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260805 22:41:21.924177 6252 raft_consensus.cc:1261] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54 [term 1 FOLLOWER]: Refusing update from remote peer 23c6ac7f3d3346c9a406dc6441640044: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:21.924196 5973 raft_consensus.cc:1261] T 37852056fd4b418a86ae28d26eaa786c P a46d4b1e511847af95a4970828744280 [term 1 FOLLOWER]: Refusing update from remote peer 23c6ac7f3d3346c9a406dc6441640044: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:21.924571 6323 consensus_queue.cc:1035] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab18915c0b4a51a9ae3a22d41dad54" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:21.924749 6326 consensus_queue.cc:1035] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46d4b1e511847af95a4970828744280" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:21.927738 6331 mvcc.cc:205] Tried to move back new op lower bound from 7315331817158414336 to 7315331817001361408. Current Snapshot: MvccSnapshot[applied={T|T < 7315331817158414336}]
I20260805 22:41:21.929807 5825 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:21.929934 5825 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:21.930750 5825 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2912ca363bbd4b29b9cb7f219c19247d: Sending DeleteTablet for 3 replicas of tablet 37852056fd4b418a86ae28d26eaa786c
I20260805 22:41:21.931114 6091 tablet_service.cc:1514] Processing DeleteTablet for tablet 37852056fd4b418a86ae28d26eaa786c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:21 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:48712
I20260805 22:41:21.931183 6231 tablet_service.cc:1514] Processing DeleteTablet for tablet 37852056fd4b418a86ae28d26eaa786c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:21 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:37932
I20260805 22:41:21.931223 5953 tablet_service.cc:1514] Processing DeleteTablet for tablet 37852056fd4b418a86ae28d26eaa786c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:21 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:42602
I20260805 22:41:21.931464 6339 tablet_replica.cc:330] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: stopping tablet replica
I20260805 22:41:21.931594 6339 raft_consensus.cc:2229] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:41:21.931737 6339 raft_consensus.cc:2258] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:21.931870 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 5888
I20260805 22:41:21.932278 6339 ts_tablet_manager.cc:1905] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:21.934497 6339 ts_tablet_manager.cc:1918] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:21.934607 6339 log.cc:1196] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/37852056fd4b418a86ae28d26eaa786c
I20260805 22:41:21.934899 6339 ts_tablet_manager.cc:1939] T 37852056fd4b418a86ae28d26eaa786c P 23c6ac7f3d3346c9a406dc6441640044: Deleting consensus metadata
I20260805 22:41:21.935585 5812 catalog_manager.cc:4841] TS 23c6ac7f3d3346c9a406dc6441640044 (127.19.77.130:37901): tablet 37852056fd4b418a86ae28d26eaa786c (table test-table [id=f5ff58d49c204b4e896977127b3e894e]) successfully deleted
I20260805 22:41:21.937479 6340 tablet_replica.cc:330] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: stopping tablet replica
I20260805 22:41:21.937636 6340 raft_consensus.cc:2229] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:41:21.937790 6340 raft_consensus.cc:2258] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:21.938316 6340 ts_tablet_manager.cc:1905] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:21.940186 6340 ts_tablet_manager.cc:1918] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:21.940332 6340 log.cc:1196] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/37852056fd4b418a86ae28d26eaa786c
I20260805 22:41:21.940697 6340 ts_tablet_manager.cc:1939] T 37852056fd4b418a86ae28d26eaa786c P b7ab18915c0b4a51a9ae3a22d41dad54: Deleting consensus metadata
I20260805 22:41:21.941274 5811 catalog_manager.cc:4841] TS b7ab18915c0b4a51a9ae3a22d41dad54 (127.19.77.131:33015): tablet 37852056fd4b418a86ae28d26eaa786c (table test-table [id=f5ff58d49c204b4e896977127b3e894e]) successfully deleted
W20260805 22:41:21.942377 5811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:36455 (error 108)
I20260805 22:41:21.943004 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:21.942859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:36455 (local address 127.0.0.1:42604)
0805 22:41:21.942922 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:21.942965 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:36455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 22:41:21.943040 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 6024
W20260805 22:41:21.944388 5811 catalog_manager.cc:4584] TS a46d4b1e511847af95a4970828744280 (127.19.77.129:36455): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 37852056fd4b418a86ae28d26eaa786c: Network error: Client connection negotiation failed: client connection to 127.19.77.129:36455: connect: Connection refused (error 111)
I20260805 22:41:21.949461 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 6165
I20260805 22:41:21.955787 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 5794
2026-08-05T22:41:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2180 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-05T22:41:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:21Z Disabled control of system clock
I20260805 22:41:21.987375 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:36167
--webserver_interface=127.19.77.190
--webserver_port=0
--builtin_ntp_servers=127.19.77.148:43485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:36167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:41:22.073684 6346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:22.073961 6346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:22.073984 6346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:22.075246 6346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:22.075296 6346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:22.075309 6346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:22.075323 6346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:22.075336 6346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:22.076763 6346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:36167
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:36167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:22.077010 6346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:22.077306 6346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:22.082636 6354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:22.082653 6352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:22.082871 6346 server_base.cc:1034] running on GCE node
W20260805 22:41:22.082644 6351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:22.083364 6346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:22.083736 6346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:22.084920 6346 hybrid_clock.cc:648] HybridClock initialized: now 1785969682084915 us; error 42 us; skew 500 ppm
I20260805 22:41:22.086419 6346 webserver.cc:460] Webserver started at http://127.19.77.190:38053/ using document root <none> and password file <none>
I20260805 22:41:22.086705 6346 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:22.086783 6346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:22.086946 6346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:22.088204 6346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "becde8c4615e4154bf47ec3cf787ae8f"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "ce0090d826ef4f3b40e44e225a568118"
server_key_iv: "da433b404429480e415055797ea28780"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.088670 6346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "becde8c4615e4154bf47ec3cf787ae8f"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "ce0090d826ef4f3b40e44e225a568118"
server_key_iv: "da433b404429480e415055797ea28780"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.090339 6346 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:41:22.091544 6360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:22.091806 6346 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:22.091949 6346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "becde8c4615e4154bf47ec3cf787ae8f"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "ce0090d826ef4f3b40e44e225a568118"
server_key_iv: "da433b404429480e415055797ea28780"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.092039 6346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:22.105047 6346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:22.105458 6346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:22.105636 6346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:22.110270 6346 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:36167
I20260805 22:41:22.110294 6416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:36167 every 8 connection(s)
I20260805 22:41:22.110713 6346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:22.111819 6417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:22.112920 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 6346
I20260805 22:41:22.113023 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:22.113276 19766 external_mini_cluster.cc:1428] Setting key e42abaf20cc565116ace6408707cab32
I20260805 22:41:22.114804 6417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f: Bootstrap starting.
I20260805 22:41:22.115552 6417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:22.115888 6417 log.cc:824] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:22.116827 6417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f: No bootstrap required, opened a new log
I20260805 22:41:22.119529 6421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.113906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42598 (local address 127.19.77.190:36167)
0805 22:41:22.114140 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.114148 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.114175 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:41:22.114614 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.114620 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.114684 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.114840 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:22.115078 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.116226 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.117391 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.117821 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.117924 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.118731 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:22.118734 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:22.118735 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:22.118911 (+ 176us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:22.118948 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:22.118959 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:22.119031 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.119215 (+ 184us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.119324 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":90,"threads_started":1}
I20260805 22:41:22.119460 6417 raft_consensus.cc:348] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "becde8c4615e4154bf47ec3cf787ae8f" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36167 } }
I20260805 22:41:22.119652 6417 raft_consensus.cc:374] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:22.119697 6417 raft_consensus.cc:729] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becde8c4615e4154bf47ec3cf787ae8f, State: Initialized, Role: FOLLOWER
I20260805 22:41:22.119843 6417 consensus_queue.cc:260] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "becde8c4615e4154bf47ec3cf787ae8f" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36167 } }
I20260805 22:41:22.119932 6417 raft_consensus.cc:388] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:22.119962 6417 raft_consensus.cc:482] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:22.120013 6417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:22.120746 6417 raft_consensus.cc:504] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "becde8c4615e4154bf47ec3cf787ae8f" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36167 } }
I20260805 22:41:22.120857 6417 leader_election.cc:302] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: becde8c4615e4154bf47ec3cf787ae8f; no voters:
I20260805 22:41:22.121088 6417 leader_election.cc:288] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:22.121189 6424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:22.121357 6424 raft_consensus.cc:686] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [term 1 LEADER]: Becoming Leader. State: Replica: becde8c4615e4154bf47ec3cf787ae8f, State: Running, Role: LEADER
I20260805 22:41:22.121438 6417 sys_catalog.cc:564] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:22.121460 6424 consensus_queue.cc:237] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "becde8c4615e4154bf47ec3cf787ae8f" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36167 } }
I20260805 22:41:22.121896 6425 sys_catalog.cc:455] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "becde8c4615e4154bf47ec3cf787ae8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "becde8c4615e4154bf47ec3cf787ae8f" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36167 } } }
I20260805 22:41:22.121907 6426 sys_catalog.cc:455] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader becde8c4615e4154bf47ec3cf787ae8f. Latest consensus state: current_term: 1 leader_uuid: "becde8c4615e4154bf47ec3cf787ae8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "becde8c4615e4154bf47ec3cf787ae8f" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 36167 } } }
I20260805 22:41:22.122138 6425 sys_catalog.cc:458] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:22.122155 6426 sys_catalog.cc:458] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:22.122624 6433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:22.123121 6433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:22.125262 6433 catalog_manager.cc:1347] Generated new cluster ID: 00b5437edcb74b18bdfd76fbf2e75c67
I20260805 22:41:22.125331 6433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:22.136394 6433 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:22.137184 6433 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:22.150405 6433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f: Generated new TSK 0
I20260805 22:41:22.150655 6433 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:22.156810 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36167
--builtin_ntp_servers=127.19.77.148:43485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:41:22.248407 6444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:22.248658 6444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:22.248684 6444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:22.250022 6444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:22.250089 6444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:22.250118 6444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:41:22.251698 6444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:22.252018 6444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:22.252388 6444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:22.257987 6449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:22.258090 6452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:22.257985 6450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:22.258638 6444 server_base.cc:1034] running on GCE node
I20260805 22:41:22.258874 6444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:22.259209 6444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:22.260430 6444 hybrid_clock.cc:648] HybridClock initialized: now 1785969682260407 us; error 39 us; skew 500 ppm
I20260805 22:41:22.262157 6444 webserver.cc:460] Webserver started at http://127.19.77.129:34013/ using document root <none> and password file <none>
I20260805 22:41:22.262466 6444 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:22.262552 6444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:22.262733 6444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:22.264097 6444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "90f1d554f2484b14bc70c8ce9920f524"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "baeded8d6ba74cc2e8f91a8f649b0c93"
server_key_iv: "7b3e1b5fdd039fcc9cbbf581fdebc0c9"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.264504 6444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "90f1d554f2484b14bc70c8ce9920f524"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "baeded8d6ba74cc2e8f91a8f649b0c93"
server_key_iv: "7b3e1b5fdd039fcc9cbbf581fdebc0c9"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.266088 6444 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:41:22.267340 6458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:22.267627 6444 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:22.267755 6444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "90f1d554f2484b14bc70c8ce9920f524"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "baeded8d6ba74cc2e8f91a8f649b0c93"
server_key_iv: "7b3e1b5fdd039fcc9cbbf581fdebc0c9"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.267864 6444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:22.285326 6444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:22.285729 6444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:22.285903 6444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:22.286196 6444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:22.286576 6444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:22.286634 6444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:22.286681 6444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:22.286710 6444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:22.293414 6444 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:39109
I20260805 22:41:22.293475 6574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:39109 every 8 connection(s)
I20260805 22:41:22.293852 6444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:41:22.294234 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 6444
I20260805 22:41:22.294351 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:41:22.294570 19766 external_mini_cluster.cc:1428] Setting key 90c7c7a7418d66e8c2d330a54eb126b9
I20260805 22:41:22.295780 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36167
--builtin_ntp_servers=127.19.77.148:43485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:41:22.300616 6421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.294722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:41025 (local address 127.19.77.190:36167)
0805 22:41:22.294797 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.294800 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.295093 (+ 293us) server_negotiation.cc:407] Connection header received
0805 22:41:22.295785 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.295786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.295803 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.295863 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:22.296589 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.297115 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.298728 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.299038 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.299117 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.300204 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:22.300206 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:22.300206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:22.300214 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:22.300234 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:22.300239 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:22.300313 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.300429 (+ 116us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.300478 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:41:22.300797 6577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.294724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:36167 (local address 127.19.77.129:41025)
0805 22:41:22.294941 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:22.295001 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:22.295674 (+ 673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:22.295944 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:22.295953 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:22.295962 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:22.296489 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.296493 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.297230 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.297233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.298618 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.298622 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.299225 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.299227 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.299373 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.300037 (+ 664us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:41:22.300038 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:22.300071 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:41:22.300098 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:22.300314 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:22.300317 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:22.300320 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:22.300422 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 22:41:22.300544 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260805 22:41:22.301468 6575 heartbeater.cc:347] Connected to a master server at 127.19.77.190:36167
I20260805 22:41:22.301602 6575 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:22.301856 6575 heartbeater.cc:511] Master 127.19.77.190:36167 requested a full tablet report, sending...
I20260805 22:41:22.302523 6378 ts_manager.cc:194] Registered new tserver with Master: 90f1d554f2484b14bc70c8ce9920f524 (127.19.77.129:39109)
I20260805 22:41:22.303261 6378 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.129:41025
W20260805 22:41:22.385425 6578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:22.385677 6578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:22.385702 6578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:22.386963 6578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:22.387020 6578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:22.387054 6578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:41:22.388572 6578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:22.388865 6578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:22.389250 6578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:22.394754 6584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:22.394757 6586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:22.395020 6578 server_base.cc:1034] running on GCE node
W20260805 22:41:22.395083 6583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:22.395437 6578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:22.395764 6578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:22.396950 6578 hybrid_clock.cc:648] HybridClock initialized: now 1785969682396916 us; error 44 us; skew 500 ppm
I20260805 22:41:22.398519 6578 webserver.cc:460] Webserver started at http://127.19.77.130:41697/ using document root <none> and password file <none>
I20260805 22:41:22.398804 6578 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:22.398885 6578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:22.399052 6578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:22.400321 6578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "3fe386e70de34f25976289ae0d0307c3"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "4bc4905be7bfc6f0b238fa458fb80c69"
server_key_iv: "337d09b64b5cb8c1fc3277f6fc33bf84"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.400723 6578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "3fe386e70de34f25976289ae0d0307c3"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "4bc4905be7bfc6f0b238fa458fb80c69"
server_key_iv: "337d09b64b5cb8c1fc3277f6fc33bf84"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.402266 6578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:41:22.403244 6592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:22.403434 6578 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:22.403551 6578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "3fe386e70de34f25976289ae0d0307c3"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "4bc4905be7bfc6f0b238fa458fb80c69"
server_key_iv: "337d09b64b5cb8c1fc3277f6fc33bf84"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.403647 6578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:22.425997 6578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:22.426395 6578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:22.426569 6578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:22.426849 6578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:22.427301 6578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:22.427359 6578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:22.427404 6578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:22.427433 6578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:22.433964 6578 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:46751
I20260805 22:41:22.434054 6708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:46751 every 8 connection(s)
I20260805 22:41:22.434456 6578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:41:22.440146 6421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.435364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:34919 (local address 127.19.77.190:36167)
0805 22:41:22.435430 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.435432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.435715 (+ 283us) server_negotiation.cc:407] Connection header received
0805 22:41:22.436234 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.436235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.436245 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.436300 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:22.437010 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.437525 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.438543 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.438731 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.438788 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.439801 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:22.439803 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:22.439803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:22.439809 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:22.439832 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:22.439836 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:22.439883 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.440035 (+ 152us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.440062 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260805 22:41:22.440317 6711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.435361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:36167 (local address 127.19.77.130:34919)
0805 22:41:22.435583 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:22.435627 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:22.436146 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:22.436354 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:22.436357 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:22.436366 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:22.436898 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.436903 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.437632 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.437633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.438460 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.438462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.438814 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.438815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.438934 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.439648 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:41:22.439648 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:22.439680 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:41:22.439706 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:22.439918 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:22.439923 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:22.439926 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:22.439997 (+ 71us) client_negotiation.cc:240] Negotiation successful
0805 22:41:22.440093 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":97,"threads_started":1}
I20260805 22:41:22.440853 6709 heartbeater.cc:347] Connected to a master server at 127.19.77.190:36167
I20260805 22:41:22.440954 6709 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:22.441129 6709 heartbeater.cc:511] Master 127.19.77.190:36167 requested a full tablet report, sending...
I20260805 22:41:22.441504 6378 ts_manager.cc:194] Registered new tserver with Master: 3fe386e70de34f25976289ae0d0307c3 (127.19.77.130:46751)
I20260805 22:41:22.441902 6378 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.130:34919
I20260805 22:41:22.443024 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 6578
I20260805 22:41:22.443107 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:41:22.443363 19766 external_mini_cluster.cc:1428] Setting key 61eeba71cd95ecda9812d06fa5922643
I20260805 22:41:22.444319 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36167
--builtin_ntp_servers=127.19.77.148:43485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:41:22.530851 6712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:22.531121 6712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:22.531188 6712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:22.532401 6712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:22.532475 6712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:22.532518 6712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:41:22.533955 6712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:22.534268 6712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:22.534616 6712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:22.539997 6717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:22.540066 6718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:22.540074 6720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:22.540230 6712 server_base.cc:1034] running on GCE node
I20260805 22:41:22.540457 6712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:22.540706 6712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:22.541851 6712 hybrid_clock.cc:648] HybridClock initialized: now 1785969682541830 us; error 45 us; skew 500 ppm
I20260805 22:41:22.543417 6712 webserver.cc:460] Webserver started at http://127.19.77.131:38699/ using document root <none> and password file <none>
I20260805 22:41:22.543712 6712 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:22.543763 6712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:22.543941 6712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:22.545115 6712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "c264a158ce054960b77332e7fbb65e7d"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "549882ddac85e349aa3a6098ed8ed843"
server_key_iv: "24293d572c3db9051f5998ab0753f83d"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.545507 6712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "c264a158ce054960b77332e7fbb65e7d"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "549882ddac85e349aa3a6098ed8ed843"
server_key_iv: "24293d572c3db9051f5998ab0753f83d"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.546954 6712 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:22.547839 6727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:22.548115 6712 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:22.548225 6712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "c264a158ce054960b77332e7fbb65e7d"
format_stamp: "Formatted at 2026-08-05 22:41:22 on dist-test-slave-chsk"
server_key: "549882ddac85e349aa3a6098ed8ed843"
server_key_iv: "24293d572c3db9051f5998ab0753f83d"
server_key_version: "encryptionkey@0"
I20260805 22:41:22.548286 6712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:22.565487 6712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:22.565806 6712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:22.565917 6712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:22.566130 6712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:22.566501 6712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:22.566537 6712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:22.566583 6712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:22.566612 6712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:22.572921 6712 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:35015
I20260805 22:41:22.573005 6842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:35015 every 8 connection(s)
I20260805 22:41:22.573365 6712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:41:22.578773 6421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.574205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:55643 (local address 127.19.77.190:36167)
0805 22:41:22.574270 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.574273 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.574556 (+ 283us) server_negotiation.cc:407] Connection header received
0805 22:41:22.575063 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.575064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.575074 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.575132 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:22.575883 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.576376 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.577372 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.577568 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.577622 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.578486 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:22.578487 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:22.578487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:22.578492 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:22.578513 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:22.578517 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:22.578562 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.578683 (+ 121us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.578708 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:41:22.578999 6845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.574207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:36167 (local address 127.19.77.131:55643)
0805 22:41:22.574424 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:22.574464 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:22.574976 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:22.575265 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:22.575269 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:22.575278 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:22.575800 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.575804 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.576464 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.576464 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.577292 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.577295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.577655 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.577656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.577778 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.578351 (+ 573us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:41:22.578351 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:22.578381 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:41:22.578405 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:22.578593 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:22.578604 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:22.578608 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:41:22.578673 (+ 65us) client_negotiation.cc:240] Negotiation successful
0805 22:41:22.578763 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":104,"threads_started":1}
I20260805 22:41:22.579607 6843 heartbeater.cc:347] Connected to a master server at 127.19.77.190:36167
I20260805 22:41:22.579725 6843 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:22.579942 6843 heartbeater.cc:511] Master 127.19.77.190:36167 requested a full tablet report, sending...
I20260805 22:41:22.580402 6378 ts_manager.cc:194] Registered new tserver with Master: c264a158ce054960b77332e7fbb65e7d (127.19.77.131:35015)
I20260805 22:41:22.580420 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 6712
I20260805 22:41:22.580549 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:41:22.580766 19766 external_mini_cluster.cc:1428] Setting key 7eb2a8f786afc96380104ab2c7a4f269
I20260805 22:41:22.580869 6378 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.131:55643
I20260805 22:41:22.581738 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:41:22.585870 6421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.583115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42606 (local address 127.19.77.190:36167)
0805 22:41:22.583184 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.583186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.583306 (+ 120us) server_negotiation.cc:407] Connection header received
0805 22:41:22.583360 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.583361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.583369 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.583418 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:22.583544 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.584011 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.584747 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.584924 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.584982 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.585643 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:22.585645 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:22.585645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:22.585650 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:22.585664 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:22.585667 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:22.585741 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.585799 (+ 58us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.585810 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260805 22:41:22.587726 6378 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42606:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:41:22.589309 6378 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:41:22.596215 6852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.591874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:39109 (local address 127.0.0.1:57872)
0805 22:41:22.592062 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:22.592071 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:22.592109 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:22.592510 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:22.592511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:22.592513 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:22.592568 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.592569 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.593871 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.593871 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.594944 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.594946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.595831 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.595832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.595894 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.595922 (+ 28us) client_negotiation.cc:769] Sending connection context
0805 22:41:22.596024 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 22:41:22.596112 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":72,"thread_start_us":98,"threads_started":1}
I20260805 22:41:22.596341 6856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.592134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57872 (local address 127.19.77.129:39109)
0805 22:41:22.592333 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.592337 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.592346 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:22.592386 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.592388 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.592402 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.592509 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:22.592631 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.593771 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.595010 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.595734 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.596077 (+ 343us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.596171 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.596200 (+ 29us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.596246 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":107,"threads_started":1}
I20260805 22:41:22.596212 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.591678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:46751 (local address 127.0.0.1:44898)
0805 22:41:22.591848 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:22.591888 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:22.591953 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:22.592404 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:22.592406 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:22.592408 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:22.592490 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.592493 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.593913 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.593914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.594764 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.594767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.595810 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.595811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.595900 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.595919 (+ 19us) client_negotiation.cc:769] Sending connection context
0805 22:41:22.596019 (+ 100us) client_negotiation.cc:240] Negotiation successful
0805 22:41:22.596094 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":61,"threads_started":1}
I20260805 22:41:22.596405 6855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.591863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50942 (local address 127.19.77.131:35015)
0805 22:41:22.592236 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.592242 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.592253 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:41:22.592294 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.592296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.592311 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.592386 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:22.592576 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.593485 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.595253 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.595857 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.595925 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.596017 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.596261 (+ 244us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.596302 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":112,"threads_started":1}
I20260805 22:41:22.596601 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.591679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:35015 (local address 127.0.0.1:50942)
0805 22:41:22.592024 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:22.592035 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:22.592094 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:22.592400 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:22.592404 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:22.592406 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:22.592485 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.592488 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.593581 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.593582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.595191 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.595193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.596053 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.596054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.596109 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.596112 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:22.596159 (+ 47us) client_negotiation.cc:240] Negotiation successful
0805 22:41:22.596197 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"mutex_wait_us":30,"thread_start_us":57,"threads_started":1}
I20260805 22:41:22.597121 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.591762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44898 (local address 127.19.77.130:46751)
0805 22:41:22.592188 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.592193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.592203 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:22.592268 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.592270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.592287 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.592571 (+ 284us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:22.592631 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.593810 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.594856 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.595714 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.595800 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.595903 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.596261 (+ 358us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.597035 (+ 774us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":108,"threads_started":1}
I20260805 22:41:22.597100 6506 tablet_service.cc:1467] Processing CreateTablet for tablet fab01b00b7fb43ae938c7641c47622c7 (DEFAULT_TABLE table=test-table [id=c8227d65a3504013a7d9fffdd32f70d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:22.597289 6775 tablet_service.cc:1467] Processing CreateTablet for tablet fab01b00b7fb43ae938c7641c47622c7 (DEFAULT_TABLE table=test-table [id=c8227d65a3504013a7d9fffdd32f70d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:22.597559 6506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fab01b00b7fb43ae938c7641c47622c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:22.597656 6775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fab01b00b7fb43ae938c7641c47622c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:22.597904 6640 tablet_service.cc:1467] Processing CreateTablet for tablet fab01b00b7fb43ae938c7641c47622c7 (DEFAULT_TABLE table=test-table [id=c8227d65a3504013a7d9fffdd32f70d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:22.598233 6640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fab01b00b7fb43ae938c7641c47622c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:22.600493 6857 tablet_bootstrap.cc:492] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524: Bootstrap starting.
I20260805 22:41:22.601166 6858 tablet_bootstrap.cc:492] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: Bootstrap starting.
I20260805 22:41:22.601338 6857 tablet_bootstrap.cc:654] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:22.601863 6858 tablet_bootstrap.cc:654] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:22.601863 6857 log.cc:824] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:22.602223 6858 log.cc:824] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:22.602581 6859 tablet_bootstrap.cc:492] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: Bootstrap starting.
I20260805 22:41:22.602797 6857 tablet_bootstrap.cc:492] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524: No bootstrap required, opened a new log
I20260805 22:41:22.602882 6857 ts_tablet_manager.cc:1397] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:41:22.602936 6858 tablet_bootstrap.cc:492] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: No bootstrap required, opened a new log
I20260805 22:41:22.603008 6858 ts_tablet_manager.cc:1397] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:41:22.603255 6859 tablet_bootstrap.cc:654] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:22.603632 6859 log.cc:824] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:22.604544 6859 tablet_bootstrap.cc:492] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: No bootstrap required, opened a new log
I20260805 22:41:22.604622 6859 ts_tablet_manager.cc:1397] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260805 22:41:22.605376 6858 raft_consensus.cc:348] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c264a158ce054960b77332e7fbb65e7d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35015 } } peers { permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 } } peers { permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 } }
I20260805 22:41:22.605558 6858 raft_consensus.cc:374] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:22.605600 6858 raft_consensus.cc:729] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c264a158ce054960b77332e7fbb65e7d, State: Initialized, Role: FOLLOWER
I20260805 22:41:22.605734 6858 consensus_queue.cc:260] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c264a158ce054960b77332e7fbb65e7d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35015 } } peers { permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 } } peers { permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 } }
I20260805 22:41:22.605845 6857 raft_consensus.cc:348] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c264a158ce054960b77332e7fbb65e7d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35015 } } peers { permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 } } peers { permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 } }
I20260805 22:41:22.606029 6857 raft_consensus.cc:374] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:22.606030 6858 ts_tablet_manager.cc:1428] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:41:22.606077 6857 raft_consensus.cc:729] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90f1d554f2484b14bc70c8ce9920f524, State: Initialized, Role: FOLLOWER
I20260805 22:41:22.606191 6843 heartbeater.cc:503] Master 127.19.77.190:36167 was elected leader, sending a full tablet report...
I20260805 22:41:22.606197 6857 consensus_queue.cc:260] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c264a158ce054960b77332e7fbb65e7d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35015 } } peers { permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 } } peers { permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 } }
I20260805 22:41:22.606468 6857 ts_tablet_manager.cc:1428] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260805 22:41:22.606515 6575 heartbeater.cc:503] Master 127.19.77.190:36167 was elected leader, sending a full tablet report...
I20260805 22:41:22.607923 6859 raft_consensus.cc:348] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c264a158ce054960b77332e7fbb65e7d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35015 } } peers { permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 } } peers { permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 } }
I20260805 22:41:22.608059 6859 raft_consensus.cc:374] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:22.608080 6859 raft_consensus.cc:729] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe386e70de34f25976289ae0d0307c3, State: Initialized, Role: FOLLOWER
I20260805 22:41:22.608192 6859 consensus_queue.cc:260] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c264a158ce054960b77332e7fbb65e7d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35015 } } peers { permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 } } peers { permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 } }
I20260805 22:41:22.608426 6859 ts_tablet_manager.cc:1428] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260805 22:41:22.608510 6709 heartbeater.cc:503] Master 127.19.77.190:36167 was elected leader, sending a full tablet report...
I20260805 22:41:22.678476 6865 raft_consensus.cc:482] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:22.678617 6865 raft_consensus.cc:504] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c264a158ce054960b77332e7fbb65e7d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35015 } } peers { permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 } } peers { permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 } }
I20260805 22:41:22.679126 6865 leader_election.cc:288] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90f1d554f2484b14bc70c8ce9920f524 (127.19.77.129:39109), 3fe386e70de34f25976289ae0d0307c3 (127.19.77.130:46751)
I20260805 22:41:22.682108 6856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.679500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:48205 (local address 127.19.77.129:39109)
0805 22:41:22.679550 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.679552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.679561 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:22.679596 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.679597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.679607 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.679686 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:22.679871 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.680352 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.681338 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.681719 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.681807 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.681815 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.682003 (+ 188us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.682047 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260805 22:41:22.682108 6845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.679365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:39109 (local address 127.19.77.131:48205)
0805 22:41:22.679423 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:22.679436 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:22.679493 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:22.679694 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:22.679695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:22.679697 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:22.679783 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.679785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.680443 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.680444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.681232 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.681235 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.681806 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.681807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.681883 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.681886 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:22.681974 (+ 88us) client_negotiation.cc:240] Negotiation successful
0805 22:41:22.682025 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260805 22:41:22.682300 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.679444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:58815 (local address 127.19.77.130:46751)
0805 22:41:22.679508 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.679510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.679737 (+ 227us) server_negotiation.cc:407] Connection header received
0805 22:41:22.679811 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.679812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.679824 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.679895 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:22.680063 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.680528 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.681502 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.681920 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.682020 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.682029 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.682191 (+ 162us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.682232 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:41:22.682319 6868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.679369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:46751 (local address 127.19.77.131:58815)
0805 22:41:22.679647 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:22.679661 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:22.679753 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:22.679898 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:22.679899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:22.679901 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:22.679982 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.679984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.680623 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.680624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.681399 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:22.681401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.682029 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.682031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:22.682106 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.682109 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:22.682184 (+ 75us) client_negotiation.cc:240] Negotiation successful
0805 22:41:22.682224 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":91,"thread_start_us":125,"threads_started":1}
I20260805 22:41:22.682521 6527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fab01b00b7fb43ae938c7641c47622c7" candidate_uuid: "c264a158ce054960b77332e7fbb65e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90f1d554f2484b14bc70c8ce9920f524" is_pre_election: true
I20260805 22:41:22.682619 6662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fab01b00b7fb43ae938c7641c47622c7" candidate_uuid: "c264a158ce054960b77332e7fbb65e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe386e70de34f25976289ae0d0307c3" is_pre_election: true
I20260805 22:41:22.682704 6527 raft_consensus.cc:2454] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c264a158ce054960b77332e7fbb65e7d in term 0.
I20260805 22:41:22.682756 6662 raft_consensus.cc:2454] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c264a158ce054960b77332e7fbb65e7d in term 0.
I20260805 22:41:22.683014 6729 leader_election.cc:302] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe386e70de34f25976289ae0d0307c3, c264a158ce054960b77332e7fbb65e7d; no voters:
I20260805 22:41:22.683194 6865 raft_consensus.cc:2781] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:41:22.683274 6865 raft_consensus.cc:482] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:41:22.683293 6865 raft_consensus.cc:3037] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:22.684077 6865 raft_consensus.cc:504] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c264a158ce054960b77332e7fbb65e7d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35015 } } peers { permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 } } peers { permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 } }
I20260805 22:41:22.684244 6865 leader_election.cc:288] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [CANDIDATE]: Term 1 election: Requested vote from peers 90f1d554f2484b14bc70c8ce9920f524 (127.19.77.129:39109), 3fe386e70de34f25976289ae0d0307c3 (127.19.77.130:46751)
I20260805 22:41:22.684419 6527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fab01b00b7fb43ae938c7641c47622c7" candidate_uuid: "c264a158ce054960b77332e7fbb65e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90f1d554f2484b14bc70c8ce9920f524"
I20260805 22:41:22.684480 6662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fab01b00b7fb43ae938c7641c47622c7" candidate_uuid: "c264a158ce054960b77332e7fbb65e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe386e70de34f25976289ae0d0307c3"
I20260805 22:41:22.684532 6527 raft_consensus.cc:3037] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:22.684569 6662 raft_consensus.cc:3037] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3 [term 0 FOLLOWER]: Advancing to term 1
W20260805 22:41:22.685078 6710 tablet.cc:2369] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:41:22.685487 6662 raft_consensus.cc:2454] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c264a158ce054960b77332e7fbb65e7d in term 1.
I20260805 22:41:22.685568 6527 raft_consensus.cc:2454] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c264a158ce054960b77332e7fbb65e7d in term 1.
I20260805 22:41:22.685670 6729 leader_election.cc:302] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe386e70de34f25976289ae0d0307c3, c264a158ce054960b77332e7fbb65e7d; no voters:
I20260805 22:41:22.685788 6865 raft_consensus.cc:2781] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:22.685976 6865 raft_consensus.cc:686] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 1 LEADER]: Becoming Leader. State: Replica: c264a158ce054960b77332e7fbb65e7d, State: Running, Role: LEADER
I20260805 22:41:22.686080 6865 consensus_queue.cc:237] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c264a158ce054960b77332e7fbb65e7d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35015 } } peers { permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 } } peers { permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 } }
I20260805 22:41:22.687023 6377 catalog_manager.cc:5495] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d reported cstate change: term changed from 0 to 1, leader changed from <none> to c264a158ce054960b77332e7fbb65e7d (127.19.77.131). New cstate: current_term: 1 leader_uuid: "c264a158ce054960b77332e7fbb65e7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c264a158ce054960b77332e7fbb65e7d" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 } health_report { overall_health: UNKNOWN } } }
I20260805 22:41:22.716188 6855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.713736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50946 (local address 127.19.77.131:35015)
0805 22:41:22.713810 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:22.713811 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:22.713820 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:22.713859 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:22.713859 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:22.713880 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:22.713973 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:22.714107 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.714591 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.715394 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:22.715594 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:22.715662 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:22.715797 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:22.715888 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:22.715961 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:22.716019 (+ 58us) server_negotiation.cc:299] Negotiation successful
0805 22:41:22.716028 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:41:22.718258 6662 raft_consensus.cc:1261] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3 [term 1 FOLLOWER]: Refusing update from remote peer c264a158ce054960b77332e7fbb65e7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:22.718266 6527 raft_consensus.cc:1261] T fab01b00b7fb43ae938c7641c47622c7 P 90f1d554f2484b14bc70c8ce9920f524 [term 1 FOLLOWER]: Refusing update from remote peer c264a158ce054960b77332e7fbb65e7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:22.718695 6865 consensus_queue.cc:1035] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "90f1d554f2484b14bc70c8ce9920f524" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 39109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:22.718868 6869 consensus_queue.cc:1035] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe386e70de34f25976289ae0d0307c3" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 46751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:22.721815 6873 mvcc.cc:205] Tried to move back new op lower bound from 7315331820410777600 to 7315331820283039744. Current Snapshot: MvccSnapshot[applied={T|T < 7315331820410777600}]
I20260805 22:41:22.724558 6378 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:22.724659 6378 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:22.725471 6378 catalog_manager.cc:5782] T 00000000000000000000000000000000 P becde8c4615e4154bf47ec3cf787ae8f: Sending DeleteTablet for 3 replicas of tablet fab01b00b7fb43ae938c7641c47622c7
I20260805 22:41:22.725795 6775 tablet_service.cc:1514] Processing DeleteTablet for tablet fab01b00b7fb43ae938c7641c47622c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:22 UTC) from {username='slave'} at 127.0.0.1:50942
I20260805 22:41:22.725847 6640 tablet_service.cc:1514] Processing DeleteTablet for tablet fab01b00b7fb43ae938c7641c47622c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:22 UTC) from {username='slave'} at 127.0.0.1:44898
I20260805 22:41:22.725921 6506 tablet_service.cc:1514] Processing DeleteTablet for tablet fab01b00b7fb43ae938c7641c47622c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:22 UTC) from {username='slave'} at 127.0.0.1:57872
I20260805 22:41:22.726189 6883 tablet_replica.cc:330] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: stopping tablet replica
I20260805 22:41:22.726269 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 6444
I20260805 22:41:22.726308 6883 raft_consensus.cc:2229] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:41:22.726440 6883 raft_consensus.cc:2258] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:22.726599 6884 tablet_replica.cc:330] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: stopping tablet replica
I20260805 22:41:22.726699 6884 raft_consensus.cc:2229] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:41:22.726794 6884 raft_consensus.cc:2258] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:22.727340 6883 ts_tablet_manager.cc:1905] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:22.727361 6884 ts_tablet_manager.cc:1905] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:22.729522 6883 ts_tablet_manager.cc:1918] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:22.729640 6884 ts_tablet_manager.cc:1918] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:22.729745 6884 log.cc:1196] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/fab01b00b7fb43ae938c7641c47622c7
I20260805 22:41:22.729751 6883 log.cc:1196] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/fab01b00b7fb43ae938c7641c47622c7
I20260805 22:41:22.730093 6884 ts_tablet_manager.cc:1939] T fab01b00b7fb43ae938c7641c47622c7 P 3fe386e70de34f25976289ae0d0307c3: Deleting consensus metadata
I20260805 22:41:22.730212 6883 ts_tablet_manager.cc:1939] T fab01b00b7fb43ae938c7641c47622c7 P c264a158ce054960b77332e7fbb65e7d: Deleting consensus metadata
I20260805 22:41:22.730691 6363 catalog_manager.cc:4841] TS 3fe386e70de34f25976289ae0d0307c3 (127.19.77.130:46751): tablet fab01b00b7fb43ae938c7641c47622c7 (table test-table [id=c8227d65a3504013a7d9fffdd32f70d1]) successfully deleted
I20260805 22:41:22.731537 6361 catalog_manager.cc:4841] TS c264a158ce054960b77332e7fbb65e7d (127.19.77.131:35015): tablet fab01b00b7fb43ae938c7641c47622c7 (table test-table [id=c8227d65a3504013a7d9fffdd32f70d1]) successfully deleted
W20260805 22:41:22.739629 6361 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:39109 (error 108)
I20260805 22:41:22.739822 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 6578
I20260805 22:41:22.740283 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:22.740142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:39109 (local address 127.0.0.1:57874)
0805 22:41:22.740203 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:22.740241 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:39109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260805 22:41:22.740401 6361 catalog_manager.cc:4584] TS 90f1d554f2484b14bc70c8ce9920f524 (127.19.77.129:39109): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fab01b00b7fb43ae938c7641c47622c7: Network error: Client connection negotiation failed: client connection to 127.19.77.129:39109: connect: Connection refused (error 111)
I20260805 22:41:22.746587 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 6712
I20260805 22:41:22.753230 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 6346
2026-08-05T22:41:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (796 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:22 dist-test-slave-chsk krb5kdc[6889](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:22 dist-test-slave-chsk krb5kdc[6889](info): set up 2 sockets
Aug 05 22:41:22 dist-test-slave-chsk krb5kdc[6889](info): commencing operation
krb5kdc: starting...
W20260805 22:41:23.818605 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:23 dist-test-slave-chsk krb5kdc[6889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:23.954265 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:40313
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:39007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:40313
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:24.040228 6903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:24.040520 6903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:24.040565 6903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:24.041843 6903 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:24.041934 6903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:24.041981 6903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:24.042014 6903 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:24.042045 6903 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:24.043740 6903 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:39007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:40313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:40313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:24.044076 6903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:24.044348 6903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:24.050165 6909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:24.050114 6911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:24.050133 6903 server_base.cc:1034] running on GCE node
W20260805 22:41:24.050110 6908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:24.050665 6903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:24.051023 6903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:24.052194 6903 hybrid_clock.cc:648] HybridClock initialized: now 1785969684052177 us; error 41 us; skew 500 ppm
Aug 05 22:41:24 dist-test-slave-chsk krb5kdc[6889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969684, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:24.055006 6903 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:24.055611 6903 webserver.cc:460] Webserver started at http://127.19.77.190:34283/ using document root <none> and password file <none>
I20260805 22:41:24.055867 6903 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:24.055917 6903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:24.056113 6903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:24.057297 6903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "eed67dce2cc34c0eab31c216d6c17694"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "4a57b37996202fcf244feae58472ef59"
server_key_iv: "3dd41919a8c52413275e9b67569030f1"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.057708 6903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "eed67dce2cc34c0eab31c216d6c17694"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "4a57b37996202fcf244feae58472ef59"
server_key_iv: "3dd41919a8c52413275e9b67569030f1"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.059561 6903 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260805 22:41:24.060636 6919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.060907 6903 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:24.061025 6903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "eed67dce2cc34c0eab31c216d6c17694"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "4a57b37996202fcf244feae58472ef59"
server_key_iv: "3dd41919a8c52413275e9b67569030f1"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.061125 6903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:24.081312 6903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:24.083566 6903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:24.083762 6903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:24.088310 6903 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:40313
I20260805 22:41:24.088356 6972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:40313 every 8 connection(s)
I20260805 22:41:24.088750 6903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:24.089709 6973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:24.090896 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 6903
I20260805 22:41:24.091051 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:24.091279 19766 external_mini_cluster.cc:1428] Setting key 607d9953bc0a05e50e65c0cfae58c573
I20260805 22:41:24.092676 6973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694: Bootstrap starting.
I20260805 22:41:24.093534 6973 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:24.093889 6973 log.cc:824] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:24.094717 6973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694: No bootstrap required, opened a new log
I20260805 22:41:24.096925 6973 raft_consensus.cc:348] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed67dce2cc34c0eab31c216d6c17694" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40313 } }
I20260805 22:41:24.097093 6973 raft_consensus.cc:374] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:24.097118 6973 raft_consensus.cc:729] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed67dce2cc34c0eab31c216d6c17694, State: Initialized, Role: FOLLOWER
I20260805 22:41:24.097266 6973 consensus_queue.cc:260] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed67dce2cc34c0eab31c216d6c17694" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40313 } }
I20260805 22:41:24.097352 6973 raft_consensus.cc:388] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:24.097378 6973 raft_consensus.cc:482] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:24.097451 6973 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:24.098107 6973 raft_consensus.cc:504] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed67dce2cc34c0eab31c216d6c17694" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40313 } }
I20260805 22:41:24.098237 6973 leader_election.cc:302] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eed67dce2cc34c0eab31c216d6c17694; no voters:
I20260805 22:41:24.098453 6973 leader_election.cc:288] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:24.098482 6978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [term 1 FOLLOWER]: Leader election won for term 1
Aug 05 22:41:24 dist-test-slave-chsk krb5kdc[6889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:24.098610 6978 raft_consensus.cc:686] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [term 1 LEADER]: Becoming Leader. State: Replica: eed67dce2cc34c0eab31c216d6c17694, State: Running, Role: LEADER
I20260805 22:41:24.098694 6978 consensus_queue.cc:237] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed67dce2cc34c0eab31c216d6c17694" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40313 } }
I20260805 22:41:24.098757 6973 sys_catalog.cc:564] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:24.099227 6980 sys_catalog.cc:455] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eed67dce2cc34c0eab31c216d6c17694" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed67dce2cc34c0eab31c216d6c17694" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40313 } } }
I20260805 22:41:24.099313 6980 sys_catalog.cc:458] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:24.099239 6981 sys_catalog.cc:455] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eed67dce2cc34c0eab31c216d6c17694. Latest consensus state: current_term: 1 leader_uuid: "eed67dce2cc34c0eab31c216d6c17694" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed67dce2cc34c0eab31c216d6c17694" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 40313 } } }
I20260805 22:41:24.100029 6981 sys_catalog.cc:458] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:24.100643 6983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:24.101195 6983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:24.102990 6983 catalog_manager.cc:1347] Generated new cluster ID: 19172c9e91984976ad5040acfecd5cdf
I20260805 22:41:24.103051 6983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:24.103930 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.091887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47882 (local address 127.19.77.190:40313)
0805 22:41:24.092081 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.092089 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.092118 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:41:24.092567 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.092574 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.092630 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.092754 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:24.093639 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.094803 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.095724 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.096174 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.096301 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.099321 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:24.099325 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:24.099326 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:24.099340 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:24.101650 (+ 2310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:24.102200 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:24.102203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:24.102204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:24.102352 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:24.102622 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:24.102623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:24.102623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:24.102956 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:24.103124 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.103565 (+ 441us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.103719 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
I20260805 22:41:24.114301 6983 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:24.114907 6983 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:24.118618 6983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694: Generated new TSK 0
I20260805 22:41:24.118845 6983 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.77.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
Entry for principal kudu/127.19.77.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab.
I20260805 22:41:24.150471 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40313
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:39007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:24.240001 7001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:24.240301 7001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:24.240347 7001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:24.241686 7001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:24.241777 7001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:24.241830 7001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:41:24.243661 7001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:39007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.129.keytab
--principal=kudu/127.19.77.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:24.243981 7001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:24.244251 7001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:24.250125 7007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:24.250116 7006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:24.250119 7009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:24.250396 7001 server_base.cc:1034] running on GCE node
I20260805 22:41:24.250695 7001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:24.250969 7001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:24.252184 7001 hybrid_clock.cc:648] HybridClock initialized: now 1785969684252159 us; error 57 us; skew 500 ppm
Aug 05 22:41:24 dist-test-slave-chsk krb5kdc[6889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969684, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:24.255295 7001 init.cc:377] Logged in from keytab as kudu/127.19.77.129@KRBTEST.COM (short username kudu)
I20260805 22:41:24.255836 7001 webserver.cc:460] Webserver started at http://127.19.77.129:46879/ using document root <none> and password file <none>
I20260805 22:41:24.256116 7001 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:24.256204 7001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:24.256371 7001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:24.257541 7001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "d6484a18580e4eba880db7d6a7d53b2a"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "6a0db2fc028da740d2f4c34b08d65e22"
server_key_iv: "324af7118fe2cfcc5fff68459887fdaa"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.257942 7001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "d6484a18580e4eba880db7d6a7d53b2a"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "6a0db2fc028da740d2f4c34b08d65e22"
server_key_iv: "324af7118fe2cfcc5fff68459887fdaa"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.259549 7001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:24.260609 7016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.260833 7001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:24.260951 7001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "d6484a18580e4eba880db7d6a7d53b2a"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "6a0db2fc028da740d2f4c34b08d65e22"
server_key_iv: "324af7118fe2cfcc5fff68459887fdaa"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.261039 7001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:24.272810 7001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:24.275538 7001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:24.275734 7001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:24.276006 7001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:24.276364 7001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:24.276427 7001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.276472 7001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:24.276516 7001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.282907 7001 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:37723
I20260805 22:41:24.282992 7134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:37723 every 8 connection(s)
I20260805 22:41:24.283387 7001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:41:24.287184 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 7001
I20260805 22:41:24.287321 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:41:24.287540 19766 external_mini_cluster.cc:1428] Setting key 402798d628a78d6af8dee96122fc7408
Aug 05 22:41:24 dist-test-slave-chsk krb5kdc[6889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969684, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.129@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:24.294955 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.284306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:49567 (local address 127.19.77.190:40313)
0805 22:41:24.284398 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.284401 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.284504 (+ 103us) server_negotiation.cc:407] Connection header received
0805 22:41:24.285091 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.285092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.285105 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.285176 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:24.286252 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.286783 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.288412 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.288640 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.288699 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.291723 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:24.291724 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:24.291725 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:24.291732 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:24.293296 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:24.293821 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:24.293823 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:24.293823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:24.293890 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:24.294187 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:24.294188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:24.294188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:24.294340 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:24.294418 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.294743 (+ 325us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.294852 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 22:41:24.295209 7137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.284209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40313 (local address 127.19.77.129:49567)
0805 22:41:24.284381 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:24.284433 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:24.284979 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:24.285266 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:24.285270 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:24.285898 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:24.286126 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.286131 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.286917 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.286919 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.288204 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.288208 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.288741 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.288742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.288898 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.289532 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:24.289543 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:24.291608 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:24.293417 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:24.293431 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:24.293434 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:24.293727 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:24.293965 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:24.293966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:24.293966 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:24.294112 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:24.294422 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:24.294432 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:24.294600 (+ 168us) client_negotiation.cc:769] Sending connection context
0805 22:41:24.294719 (+ 119us) client_negotiation.cc:240] Negotiation successful
0805 22:41:24.294917 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260805 22:41:24.295854 7135 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40313
I20260805 22:41:24.295995 7135 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:24.296253 7135 heartbeater.cc:511] Master 127.19.77.190:40313 requested a full tablet report, sending...
I20260805 22:41:24.296861 6936 ts_manager.cc:194] Registered new tserver with Master: d6484a18580e4eba880db7d6a7d53b2a (127.19.77.129:37723)
WARNING: no policy specified for kudu/127.19.77.130@KRBTEST.COM; defaulting to no policy
I20260805 22:41:24.297530 6936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.129@KRBTEST.COM'} at 127.19.77.129:49567
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
Entry for principal kudu/127.19.77.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab.
I20260805 22:41:24.318841 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40313
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:39007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:24.409123 7140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:24.409380 7140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:24.409411 7140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:24.410750 7140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:24.410815 7140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:24.410844 7140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:41:24.412585 7140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:39007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.130.keytab
--principal=kudu/127.19.77.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:24.412883 7140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:24.413163 7140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:24.419272 7148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:24.419538 7140 server_base.cc:1034] running on GCE node
W20260805 22:41:24.419477 7145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:24.419312 7146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:24.420011 7140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:24.420585 7140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:24.421830 7140 hybrid_clock.cc:648] HybridClock initialized: now 1785969684421782 us; error 65 us; skew 500 ppm
Aug 05 22:41:24 dist-test-slave-chsk krb5kdc[6889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969684, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:24.424930 7140 init.cc:377] Logged in from keytab as kudu/127.19.77.130@KRBTEST.COM (short username kudu)
I20260805 22:41:24.425505 7140 webserver.cc:460] Webserver started at http://127.19.77.130:43851/ using document root <none> and password file <none>
I20260805 22:41:24.425781 7140 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:24.425858 7140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:24.426020 7140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:24.427251 7140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "172d2e0ee9b8448399e38ef03869eee4"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "5ddc7cd1d71baf8022c76f50014c6810"
server_key_iv: "a4bca6869d54849237b891ef14f7425b"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.427646 7140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "172d2e0ee9b8448399e38ef03869eee4"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "5ddc7cd1d71baf8022c76f50014c6810"
server_key_iv: "a4bca6869d54849237b891ef14f7425b"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.429150 7140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:41:24.429960 7155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.430214 7140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:24.430286 7140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "172d2e0ee9b8448399e38ef03869eee4"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "5ddc7cd1d71baf8022c76f50014c6810"
server_key_iv: "a4bca6869d54849237b891ef14f7425b"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.430343 7140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:24.443997 7140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:24.446413 7140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:24.446539 7140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:24.446751 7140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:24.447129 7140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:24.447237 7140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.447261 7140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:24.447275 7140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.453965 7140 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:37875
I20260805 22:41:24.454017 7270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:37875 every 8 connection(s)
I20260805 22:41:24.454452 7140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:41:24.455343 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 7140
I20260805 22:41:24.455472 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:41:24.455685 19766 external_mini_cluster.cc:1428] Setting key 77f656fbfd3185aa08ed457a2b66423a
Aug 05 22:41:24 dist-test-slave-chsk krb5kdc[6889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969684, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.130@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.131@KRBTEST.COM; defaulting to no policy
I20260805 22:41:24.466936 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.455249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:54489 (local address 127.19.77.190:40313)
0805 22:41:24.455324 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.455327 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.455563 (+ 236us) server_negotiation.cc:407] Connection header received
0805 22:41:24.456160 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.456161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.456173 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.456240 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:24.457417 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.458190 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.459472 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.459696 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.459780 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.462991 (+ 3211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:24.463002 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:24.463002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:24.463015 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:24.465306 (+ 2291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:24.465891 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:24.465892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:24.465893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:24.465952 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:24.466204 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:24.466204 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:24.466204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:24.466324 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:24.466378 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.466729 (+ 351us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.466833 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260805 22:41:24.467211 7274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.455237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40313 (local address 127.19.77.130:54489)
0805 22:41:24.455430 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:24.455475 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:24.456085 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:24.456373 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:24.456378 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:24.457055 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:24.457293 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.457299 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.458335 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.458336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.459370 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.459373 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.459808 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.459809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.459947 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.460813 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:24.460834 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:24.462850 (+ 2016us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:24.465485 (+ 2635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:24.465506 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:24.465508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:24.465792 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:24.466022 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:24.466023 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:24.466023 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:24.466132 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:24.466398 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:24.466408 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:24.466552 (+ 144us) client_negotiation.cc:769] Sending connection context
0805 22:41:24.466703 (+ 151us) client_negotiation.cc:240] Negotiation successful
0805 22:41:24.466899 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":111,"threads_started":1}
I20260805 22:41:24.468045 7271 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40313
I20260805 22:41:24.468189 7271 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.131@KRBTEST.COM" created.
I20260805 22:41:24.468420 7271 heartbeater.cc:511] Master 127.19.77.190:40313 requested a full tablet report, sending...
I20260805 22:41:24.468912 6936 ts_manager.cc:194] Registered new tserver with Master: 172d2e0ee9b8448399e38ef03869eee4 (127.19.77.130:37875)
I20260805 22:41:24.469420 6936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.130@KRBTEST.COM'} at 127.19.77.130:54489
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
Entry for principal kudu/127.19.77.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab.
I20260805 22:41:24.486364 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40313
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:39007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:24.574928 7277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:24.575300 7277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:24.575354 7277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:24.576817 7277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:24.576884 7277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:24.576915 7277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:41:24.578485 7277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:39007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.131.keytab
--principal=kudu/127.19.77.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:40313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:24.578727 7277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:24.578931 7277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:24.585270 7285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:24.585397 7277 server_base.cc:1034] running on GCE node
W20260805 22:41:24.585282 7283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:24.585286 7282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:24.585819 7277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:24.586118 7277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:24.587293 7277 hybrid_clock.cc:648] HybridClock initialized: now 1785969684587262 us; error 49 us; skew 500 ppm
Aug 05 22:41:24 dist-test-slave-chsk krb5kdc[6889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969684, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:24.590164 7277 init.cc:377] Logged in from keytab as kudu/127.19.77.131@KRBTEST.COM (short username kudu)
I20260805 22:41:24.590687 7277 webserver.cc:460] Webserver started at http://127.19.77.131:34765/ using document root <none> and password file <none>
I20260805 22:41:24.590966 7277 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:24.591044 7277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:24.591243 7277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:24.592386 7277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "f9917fa4cc5b4abc86636ea6a60fe57e"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "5132447201a141eeae34662f7bbf55bf"
server_key_iv: "dc4efa9cf76d61ff5fb8f26d121dc775"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.592798 7277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "f9917fa4cc5b4abc86636ea6a60fe57e"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "5132447201a141eeae34662f7bbf55bf"
server_key_iv: "dc4efa9cf76d61ff5fb8f26d121dc775"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.594476 7277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:24.595427 7292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.595669 7277 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:24.595773 7277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "f9917fa4cc5b4abc86636ea6a60fe57e"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "5132447201a141eeae34662f7bbf55bf"
server_key_iv: "dc4efa9cf76d61ff5fb8f26d121dc775"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.595870 7277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:24.628562 7277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:24.631558 7277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:24.631732 7277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:24.632077 7277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:24.632441 7277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:24.632498 7277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.632547 7277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:24.632575 7277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.638895 7277 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:33103
I20260805 22:41:24.638938 7410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:33103 every 8 connection(s)
I20260805 22:41:24.639351 7277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:41:24.644466 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 7277
I20260805 22:41:24.644595 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:41:24.644796 19766 external_mini_cluster.cc:1428] Setting key 7b186e582b8b6bc4841e4c0551957f95
Aug 05 22:41:24 dist-test-slave-chsk krb5kdc[6889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969684, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.131@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:24.649312 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.640150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:37561 (local address 127.19.77.190:40313)
0805 22:41:24.640222 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.640225 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.640451 (+ 226us) server_negotiation.cc:407] Connection header received
0805 22:41:24.640953 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.640954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.640965 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.641022 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:24.642013 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.642523 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.643661 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.643851 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.643911 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.646535 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:24.646536 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:24.646536 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:24.646543 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:24.647970 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:24.648396 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:24.648396 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:24.648397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:24.648448 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:24.648723 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:24.648724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:24.648725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:24.648853 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:24.648916 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.649175 (+ 259us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.649244 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:41:24.649567 7413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.640110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:40313 (local address 127.19.77.131:37561)
0805 22:41:24.640320 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:24.640363 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:24.640860 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:24.641081 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:24.641084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:24.641690 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:24.641898 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.641903 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.642626 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.642627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.643575 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.643578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.643935 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.643936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.644038 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.644597 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:24.644608 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:24.646453 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:24.648064 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:24.648072 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:24.648074 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:24.648325 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:24.648510 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:24.648511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:24.648511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:24.648641 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:24.648917 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:24.648922 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:24.649050 (+ 128us) client_negotiation.cc:769] Sending connection context
0805 22:41:24.649147 (+ 97us) client_negotiation.cc:240] Negotiation successful
0805 22:41:24.649284 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":115,"threads_started":1}
I20260805 22:41:24.650151 7411 heartbeater.cc:347] Connected to a master server at 127.19.77.190:40313
I20260805 22:41:24.650272 7411 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:24.650473 7411 heartbeater.cc:511] Master 127.19.77.190:40313 requested a full tablet report, sending...
I20260805 22:41:24.650908 6936 ts_manager.cc:194] Registered new tserver with Master: f9917fa4cc5b4abc86636ea6a60fe57e (127.19.77.131:33103)
I20260805 22:41:24.651393 6936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.77.131@KRBTEST.COM'} at 127.19.77.131:37561
I20260805 22:41:24.656934 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:41:24.664784 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.658329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47892 (local address 127.19.77.190:40313)
0805 22:41:24.658395 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.658397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.658507 (+ 110us) server_negotiation.cc:407] Connection header received
0805 22:41:24.658549 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.658549 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.658560 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.658608 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:24.659191 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.659696 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.660432 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.660622 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.660681 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.662013 (+ 1332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:24.662016 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:24.662016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:24.662023 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:24.663406 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:24.663729 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:24.663731 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:24.663731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:24.663831 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:24.664054 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:24.664055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:24.664055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:24.664347 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:24.664430 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.664584 (+ 154us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.664657 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:41:24.666604 6936 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:41:24.668303 6936 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:41:24.675550 7423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.670915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33103 (local address 127.0.0.1:33950)
0805 22:41:24.671103 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:24.671179 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:24.671253 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:24.671833 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:24.671834 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:24.671836 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:24.671902 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.671904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.672873 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.672875 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.674155 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.674157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.675207 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.675208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.675296 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.675313 (+ 17us) client_negotiation.cc:769] Sending connection context
0805 22:41:24.675389 (+ 76us) client_negotiation.cc:240] Negotiation successful
0805 22:41:24.675447 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":110,"threads_started":1}
I20260805 22:41:24.675582 7425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.671033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33950 (local address 127.19.77.131:33103)
0805 22:41:24.671653 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.671657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.671668 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:41:24.671711 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.671713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.671728 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.671982 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:24.672061 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.672767 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.674263 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.675064 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.675177 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.675266 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.675424 (+ 158us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.675479 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":97,"threads_started":1}
I20260805 22:41:24.675721 7426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.671128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:37875 (local address 127.0.0.1:40608)
0805 22:41:24.671284 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:24.671293 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:24.671337 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:24.671957 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:24.671958 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:24.671960 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:24.671993 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.671994 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.673289 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.673291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.674325 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.674326 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.675299 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.675300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.675398 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.675404 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:41:24.675450 (+ 46us) client_negotiation.cc:240] Negotiation successful
0805 22:41:24.675498 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":115,"threads_started":1}
I20260805 22:41:24.676075 7428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.671605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40608 (local address 127.19.77.130:37875)
0805 22:41:24.671813 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.671816 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.671826 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:24.671864 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.671866 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.671879 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.671961 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:24.672073 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.673166 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.674419 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.675197 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.675823 (+ 626us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.675902 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.675931 (+ 29us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.675979 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":93,"threads_started":1}
I20260805 22:41:24.676741 7424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.670882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:37723 (local address 127.0.0.1:40202)
0805 22:41:24.671104 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:24.671193 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:24.671253 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:24.671790 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:24.671794 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:24.671797 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:24.671881 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.671883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.674395 (+ 2512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.674396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.675105 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.675107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.676478 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.676479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.676551 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.676557 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:41:24.676624 (+ 67us) client_negotiation.cc:240] Negotiation successful
0805 22:41:24.676673 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":74,"threads_started":1}
I20260805 22:41:24.676623 7343 tablet_service.cc:1467] Processing CreateTablet for tablet 155a139ec11547af831bc92484af3d63 (DEFAULT_TABLE table=test-table [id=e2fb7ca1b89744cfbe88668ba6376563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:24.676797 7427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.671333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40202 (local address 127.19.77.129:37723)
0805 22:41:24.671494 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.671498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.671508 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:24.671575 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.671578 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.671595 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.671680 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:24.671976 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.673177 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.675245 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.676365 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.676448 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.676502 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.676659 (+ 157us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.676708 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260805 22:41:24.676776 7205 tablet_service.cc:1467] Processing CreateTablet for tablet 155a139ec11547af831bc92484af3d63 (DEFAULT_TABLE table=test-table [id=e2fb7ca1b89744cfbe88668ba6376563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:24.677059 7343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 155a139ec11547af831bc92484af3d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:24.677152 7205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 155a139ec11547af831bc92484af3d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:24.677469 7067 tablet_service.cc:1467] Processing CreateTablet for tablet 155a139ec11547af831bc92484af3d63 (DEFAULT_TABLE table=test-table [id=e2fb7ca1b89744cfbe88668ba6376563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:24.677798 7067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 155a139ec11547af831bc92484af3d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:24.680264 7429 tablet_bootstrap.cc:492] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: Bootstrap starting.
I20260805 22:41:24.680704 7430 tablet_bootstrap.cc:492] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: Bootstrap starting.
I20260805 22:41:24.681036 7429 tablet_bootstrap.cc:654] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:24.681457 7430 tablet_bootstrap.cc:654] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:24.681829 7429 log.cc:824] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:24.682070 7430 log.cc:824] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:24.682291 7431 tablet_bootstrap.cc:492] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a: Bootstrap starting.
I20260805 22:41:24.682876 7431 tablet_bootstrap.cc:654] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:24.682870 7429 tablet_bootstrap.cc:492] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: No bootstrap required, opened a new log
I20260805 22:41:24.682879 7430 tablet_bootstrap.cc:492] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: No bootstrap required, opened a new log
I20260805 22:41:24.682971 7430 ts_tablet_manager.cc:1397] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:41:24.682978 7429 ts_tablet_manager.cc:1397] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:41:24.683442 7431 log.cc:824] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:24.684154 7431 tablet_bootstrap.cc:492] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a: No bootstrap required, opened a new log
I20260805 22:41:24.684237 7431 ts_tablet_manager.cc:1397] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:41:24.685115 7430 raft_consensus.cc:348] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 } } peers { permanent_uuid: "172d2e0ee9b8448399e38ef03869eee4" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37875 } } peers { permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 } }
I20260805 22:41:24.685117 7429 raft_consensus.cc:348] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 } } peers { permanent_uuid: "172d2e0ee9b8448399e38ef03869eee4" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37875 } } peers { permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 } }
I20260805 22:41:24.685322 7430 raft_consensus.cc:374] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:24.685322 7429 raft_consensus.cc:374] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:24.685362 7430 raft_consensus.cc:729] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9917fa4cc5b4abc86636ea6a60fe57e, State: Initialized, Role: FOLLOWER
I20260805 22:41:24.685361 7429 raft_consensus.cc:729] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 172d2e0ee9b8448399e38ef03869eee4, State: Initialized, Role: FOLLOWER
I20260805 22:41:24.685495 7429 consensus_queue.cc:260] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 } } peers { permanent_uuid: "172d2e0ee9b8448399e38ef03869eee4" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37875 } } peers { permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 } }
I20260805 22:41:24.685495 7430 consensus_queue.cc:260] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 } } peers { permanent_uuid: "172d2e0ee9b8448399e38ef03869eee4" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37875 } } peers { permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 } }
I20260805 22:41:24.685827 7429 ts_tablet_manager.cc:1428] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:41:24.685858 7430 ts_tablet_manager.cc:1428] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:41:24.685985 7411 heartbeater.cc:503] Master 127.19.77.190:40313 was elected leader, sending a full tablet report...
I20260805 22:41:24.685977 7271 heartbeater.cc:503] Master 127.19.77.190:40313 was elected leader, sending a full tablet report...
I20260805 22:41:24.686306 7431 raft_consensus.cc:348] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 } } peers { permanent_uuid: "172d2e0ee9b8448399e38ef03869eee4" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37875 } } peers { permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 } }
I20260805 22:41:24.686512 7431 raft_consensus.cc:374] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:24.686579 7431 raft_consensus.cc:729] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6484a18580e4eba880db7d6a7d53b2a, State: Initialized, Role: FOLLOWER
I20260805 22:41:24.686707 7431 consensus_queue.cc:260] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 } } peers { permanent_uuid: "172d2e0ee9b8448399e38ef03869eee4" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37875 } } peers { permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 } }
I20260805 22:41:24.687016 7135 heartbeater.cc:503] Master 127.19.77.190:40313 was elected leader, sending a full tablet report...
I20260805 22:41:24.686997 7431 ts_tablet_manager.cc:1428] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260805 22:41:24.705083 7273 tablet.cc:2369] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:41:24.784297 7136 tablet.cc:2369] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:41:24.808171 7435 raft_consensus.cc:482] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:24.808316 7435 raft_consensus.cc:504] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 } } peers { permanent_uuid: "172d2e0ee9b8448399e38ef03869eee4" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37875 } } peers { permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 } }
I20260805 22:41:24.808751 7435 leader_election.cc:288] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6484a18580e4eba880db7d6a7d53b2a (127.19.77.129:37723), f9917fa4cc5b4abc86636ea6a60fe57e (127.19.77.131:33103)
I20260805 22:41:24.812036 7425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.809102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:37649 (local address 127.19.77.131:33103)
0805 22:41:24.809167 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.809169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.809407 (+ 238us) server_negotiation.cc:407] Connection header received
0805 22:41:24.809466 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.809467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.809479 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.809534 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:24.809701 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.810198 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.811252 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.811645 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.811737 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.811746 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.811908 (+ 162us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.811950 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260805 22:41:24.812050 7274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.808994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:37723 (local address 127.19.77.130:55269)
0805 22:41:24.809070 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:24.809081 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:24.809143 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:24.809351 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:24.809352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:24.809354 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:24.809457 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.809459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.810214 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.810216 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.811095 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.811099 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.811723 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.811725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.811825 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.811829 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:41:24.811902 (+ 73us) client_negotiation.cc:240] Negotiation successful
0805 22:41:24.811956 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":64}
I20260805 22:41:24.812036 7427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.809047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:55269 (local address 127.19.77.129:37723)
0805 22:41:24.809115 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.809118 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.809132 (+ 14us) server_negotiation.cc:407] Connection header received
0805 22:41:24.809233 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.809234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.809263 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.809337 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:24.809559 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.810125 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.811250 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.811637 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.811697 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.811730 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.811911 (+ 181us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.811953 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:41:24.812075 7438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.809004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:33103 (local address 127.19.77.130:37649)
0805 22:41:24.809320 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:24.809331 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:24.809393 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:24.809553 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:24.809554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:24.809556 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:24.809628 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.809630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.810289 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.810290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.811098 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:24.811100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.811751 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.811753 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:24.811827 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.811830 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:24.811902 (+ 72us) client_negotiation.cc:240] Negotiation successful
0805 22:41:24.811953 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":86,"thread_start_us":150,"threads_started":1}
I20260805 22:41:24.812436 7087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "155a139ec11547af831bc92484af3d63" candidate_uuid: "172d2e0ee9b8448399e38ef03869eee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6484a18580e4eba880db7d6a7d53b2a" is_pre_election: true
I20260805 22:41:24.812485 7364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "155a139ec11547af831bc92484af3d63" candidate_uuid: "172d2e0ee9b8448399e38ef03869eee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" is_pre_election: true
I20260805 22:41:24.812644 7087 raft_consensus.cc:2454] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 172d2e0ee9b8448399e38ef03869eee4 in term 0.
I20260805 22:41:24.812664 7364 raft_consensus.cc:2454] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 172d2e0ee9b8448399e38ef03869eee4 in term 0.
I20260805 22:41:24.812928 7159 leader_election.cc:302] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 172d2e0ee9b8448399e38ef03869eee4, d6484a18580e4eba880db7d6a7d53b2a; no voters:
I20260805 22:41:24.813081 7435 raft_consensus.cc:2781] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:41:24.813143 7435 raft_consensus.cc:482] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:41:24.813179 7435 raft_consensus.cc:3037] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:24.813951 7435 raft_consensus.cc:504] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 } } peers { permanent_uuid: "172d2e0ee9b8448399e38ef03869eee4" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37875 } } peers { permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 } }
I20260805 22:41:24.814117 7435 leader_election.cc:288] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [CANDIDATE]: Term 1 election: Requested vote from peers d6484a18580e4eba880db7d6a7d53b2a (127.19.77.129:37723), f9917fa4cc5b4abc86636ea6a60fe57e (127.19.77.131:33103)
I20260805 22:41:24.814301 7364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "155a139ec11547af831bc92484af3d63" candidate_uuid: "172d2e0ee9b8448399e38ef03869eee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e"
I20260805 22:41:24.814343 7087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "155a139ec11547af831bc92484af3d63" candidate_uuid: "172d2e0ee9b8448399e38ef03869eee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6484a18580e4eba880db7d6a7d53b2a"
I20260805 22:41:24.814390 7364 raft_consensus.cc:3037] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:24.814443 7087 raft_consensus.cc:3037] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:24.815289 7364 raft_consensus.cc:2454] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 172d2e0ee9b8448399e38ef03869eee4 in term 1.
I20260805 22:41:24.815457 7087 raft_consensus.cc:2454] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 172d2e0ee9b8448399e38ef03869eee4 in term 1.
I20260805 22:41:24.815483 7157 leader_election.cc:302] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 172d2e0ee9b8448399e38ef03869eee4, f9917fa4cc5b4abc86636ea6a60fe57e; no voters:
I20260805 22:41:24.815606 7435 raft_consensus.cc:2781] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:24.815821 7435 raft_consensus.cc:686] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 1 LEADER]: Becoming Leader. State: Replica: 172d2e0ee9b8448399e38ef03869eee4, State: Running, Role: LEADER
I20260805 22:41:24.815945 7435 consensus_queue.cc:237] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 } } peers { permanent_uuid: "172d2e0ee9b8448399e38ef03869eee4" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37875 } } peers { permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 } }
I20260805 22:41:24.816761 6936 catalog_manager.cc:5495] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 172d2e0ee9b8448399e38ef03869eee4 (127.19.77.130). New cstate: current_term: 1 leader_uuid: "172d2e0ee9b8448399e38ef03869eee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "172d2e0ee9b8448399e38ef03869eee4" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 37875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 } health_report { overall_health: UNKNOWN } } }
I20260805 22:41:24.825786 7428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.823286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40622 (local address 127.19.77.130:37875)
0805 22:41:24.823351 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:24.823353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:24.823363 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:24.823408 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:24.823409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:24.823435 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:24.823517 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:24.823665 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.824156 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.824924 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:24.825131 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:24.825220 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:24.825398 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:24.825510 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:24.825604 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:24.825635 (+ 31us) server_negotiation.cc:299] Negotiation successful
0805 22:41:24.825659 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 22:41:24.827986 7087 raft_consensus.cc:1261] T 155a139ec11547af831bc92484af3d63 P d6484a18580e4eba880db7d6a7d53b2a [term 1 FOLLOWER]: Refusing update from remote peer 172d2e0ee9b8448399e38ef03869eee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:24.828271 7364 raft_consensus.cc:1261] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e [term 1 FOLLOWER]: Refusing update from remote peer 172d2e0ee9b8448399e38ef03869eee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:24.828408 7439 consensus_queue.cc:1035] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6484a18580e4eba880db7d6a7d53b2a" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:24.828639 7435 consensus_queue.cc:1035] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9917fa4cc5b4abc86636ea6a60fe57e" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 33103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:24.831414 7445 mvcc.cc:205] Tried to move back new op lower bound from 7315331829051301888 to 7315331829006569472. Current Snapshot: MvccSnapshot[applied={T|T < 7315331829051301888}]
I20260805 22:41:24.832163 7443 mvcc.cc:205] Tried to move back new op lower bound from 7315331829051301888 to 7315331829006569472. Current Snapshot: MvccSnapshot[applied={T|T < 7315331829051301888 or (T in {7315331829051301888})}]
I20260805 22:41:24.833855 6936 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:24.833972 6936 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:24.834872 6936 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eed67dce2cc34c0eab31c216d6c17694: Sending DeleteTablet for 3 replicas of tablet 155a139ec11547af831bc92484af3d63
I20260805 22:41:24.835307 7067 tablet_service.cc:1514] Processing DeleteTablet for tablet 155a139ec11547af831bc92484af3d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:24 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:40202
I20260805 22:41:24.835309 7343 tablet_service.cc:1514] Processing DeleteTablet for tablet 155a139ec11547af831bc92484af3d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:24 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:33950
I20260805 22:41:24.835673 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 7001
I20260805 22:41:24.837353 7205 tablet_service.cc:1514] Processing DeleteTablet for tablet 155a139ec11547af831bc92484af3d63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:24 UTC) from {username='kudu', principal='kudu/127.19.77.190@KRBTEST.COM'} at 127.0.0.1:40608
I20260805 22:41:24.837397 7453 tablet_replica.cc:330] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: stopping tablet replica
I20260805 22:41:24.837687 7453 raft_consensus.cc:2229] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:41:24.837888 7453 raft_consensus.cc:2258] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:24.838444 7453 ts_tablet_manager.cc:1905] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:24.839300 7455 tablet_replica.cc:330] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: stopping tablet replica
I20260805 22:41:24.839429 7455 raft_consensus.cc:2229] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:41:24.839582 7455 raft_consensus.cc:2258] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:24.840087 7455 ts_tablet_manager.cc:1905] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:24.841032 7453 ts_tablet_manager.cc:1918] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:24.841182 7453 log.cc:1196] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/155a139ec11547af831bc92484af3d63
I20260805 22:41:24.841566 7453 ts_tablet_manager.cc:1939] T 155a139ec11547af831bc92484af3d63 P f9917fa4cc5b4abc86636ea6a60fe57e: Deleting consensus metadata
I20260805 22:41:24.841895 7455 ts_tablet_manager.cc:1918] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:24.842000 7455 log.cc:1196] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/155a139ec11547af831bc92484af3d63
I20260805 22:41:24.842295 7455 ts_tablet_manager.cc:1939] T 155a139ec11547af831bc92484af3d63 P 172d2e0ee9b8448399e38ef03869eee4: Deleting consensus metadata
I20260805 22:41:24.842306 6921 catalog_manager.cc:4841] TS f9917fa4cc5b4abc86636ea6a60fe57e (127.19.77.131:33103): tablet 155a139ec11547af831bc92484af3d63 (table test-table [id=e2fb7ca1b89744cfbe88668ba6376563]) successfully deleted
I20260805 22:41:24.842778 6923 catalog_manager.cc:4841] TS 172d2e0ee9b8448399e38ef03869eee4 (127.19.77.130:37875): tablet 155a139ec11547af831bc92484af3d63 (table test-table [id=e2fb7ca1b89744cfbe88668ba6376563]) successfully deleted
W20260805 22:41:24.844237 6923 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:37723 (error 108)
I20260805 22:41:24.844889 7424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:24.844753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:37723 (local address 127.0.0.1:40216)
0805 22:41:24.844812 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:24.844850 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:37723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260805 22:41:24.844905 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 7140
W20260805 22:41:24.845031 6923 catalog_manager.cc:4584] TS d6484a18580e4eba880db7d6a7d53b2a (127.19.77.129:37723): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 155a139ec11547af831bc92484af3d63: Network error: Client connection negotiation failed: client connection to 127.19.77.129:37723: connect: Connection refused (error 111)
I20260805 22:41:24.850708 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 7277
I20260805 22:41:24.856841 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 6903
2026-08-05T22:41:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2104 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-05T22:41:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:24Z Disabled control of system clock
I20260805 22:41:24.889427 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:42553
--webserver_interface=127.19.77.190
--webserver_port=0
--builtin_ntp_servers=127.19.77.148:43199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:42553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:41:24.977535 7460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:24.977803 7460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:24.977828 7460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:24.979205 7460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:24.979301 7460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:24.979326 7460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:24.979341 7460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:24.979353 7460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:24.980855 7460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:42553
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:42553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:24.981122 7460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:24.981420 7460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:24.986692 7468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:24.986722 7465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:24.986702 7466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:24.987107 7460 server_base.cc:1034] running on GCE node
I20260805 22:41:24.987413 7460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:24.987790 7460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:24.988967 7460 hybrid_clock.cc:648] HybridClock initialized: now 1785969684988935 us; error 52 us; skew 500 ppm
I20260805 22:41:24.990581 7460 webserver.cc:460] Webserver started at http://127.19.77.190:33915/ using document root <none> and password file <none>
I20260805 22:41:24.990863 7460 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:24.990918 7460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:24.991107 7460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:24.992331 7460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "77ccb3d867e6472a90927f339ed3f492"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "6aac77ccad430b22d6774abaa1b3e7d7"
server_key_iv: "b9f6e984ca80cbddada80b80f78e173b"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.992729 7460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "77ccb3d867e6472a90927f339ed3f492"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "6aac77ccad430b22d6774abaa1b3e7d7"
server_key_iv: "b9f6e984ca80cbddada80b80f78e173b"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.994277 7460 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:24.995237 7474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:24.995447 7460 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:24.995558 7460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "77ccb3d867e6472a90927f339ed3f492"
format_stamp: "Formatted at 2026-08-05 22:41:24 on dist-test-slave-chsk"
server_key: "6aac77ccad430b22d6774abaa1b3e7d7"
server_key_iv: "b9f6e984ca80cbddada80b80f78e173b"
server_key_version: "encryptionkey@0"
I20260805 22:41:24.995643 7460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:25.007085 7460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:25.007565 7460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:25.007727 7460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:25.012207 7460 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:42553
I20260805 22:41:25.012284 7528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:42553 every 8 connection(s)
I20260805 22:41:25.012673 7460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:25.013769 7529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:25.016371 7529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492: Bootstrap starting.
I20260805 22:41:25.016417 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 7460
I20260805 22:41:25.016551 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:25.016755 19766 external_mini_cluster.cc:1428] Setting key 40865de687692108fc5d60908b99cdfd
I20260805 22:41:25.017169 7529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:25.017589 7529 log.cc:824] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:25.018428 7529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492: No bootstrap required, opened a new log
I20260805 22:41:25.020923 7529 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ccb3d867e6472a90927f339ed3f492" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42553 } }
I20260805 22:41:25.021162 7529 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:25.021201 7529 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ccb3d867e6472a90927f339ed3f492, State: Initialized, Role: FOLLOWER
I20260805 22:41:25.021329 7529 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ccb3d867e6472a90927f339ed3f492" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42553 } }
I20260805 22:41:25.021404 7529 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:25.021435 7529 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:25.021481 7529 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:25.022287 7529 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ccb3d867e6472a90927f339ed3f492" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42553 } }
I20260805 22:41:25.022419 7529 leader_election.cc:302] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77ccb3d867e6472a90927f339ed3f492; no voters:
I20260805 22:41:25.022686 7529 leader_election.cc:288] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:25.022716 7534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:25.022837 7534 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [term 1 LEADER]: Becoming Leader. State: Replica: 77ccb3d867e6472a90927f339ed3f492, State: Running, Role: LEADER
I20260805 22:41:25.022928 7534 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ccb3d867e6472a90927f339ed3f492" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42553 } }
I20260805 22:41:25.023006 7529 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:25.023293 7534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77ccb3d867e6472a90927f339ed3f492. Latest consensus state: current_term: 1 leader_uuid: "77ccb3d867e6472a90927f339ed3f492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ccb3d867e6472a90927f339ed3f492" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42553 } } }
I20260805 22:41:25.023367 7534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:25.023311 7536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77ccb3d867e6472a90927f339ed3f492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ccb3d867e6472a90927f339ed3f492" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 42553 } } }
I20260805 22:41:25.023557 7536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:25.023603 7538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:25.023808 7532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.017341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40148 (local address 127.19.77.190:42553)
0805 22:41:25.017577 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.017585 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.017612 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:41:25.018133 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.018140 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.018204 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.018330 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:25.018653 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.020177 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.021053 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.021704 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.021829 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.022630 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:25.022635 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:25.022635 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:25.022884 (+ 249us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:25.022933 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:25.022950 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:25.023343 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.023381 (+ 38us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.023479 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":110,"threads_started":1}
I20260805 22:41:25.024163 7538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:25.029237 7538 catalog_manager.cc:1347] Generated new cluster ID: 3e106bd7fc854ef3b8cfcaeee5979598
I20260805 22:41:25.029337 7538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:25.068171 7538 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:25.069147 7538 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:25.074540 7538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492: Generated new TSK 0
I20260805 22:41:25.074793 7538 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:25.082971 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.129:0
--local_ip_for_outbound_sockets=127.19.77.129
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42553
--builtin_ntp_servers=127.19.77.148:43199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:41:25.192025 7553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:25.192272 7553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:25.192298 7553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:25.193593 7553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:25.193646 7553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:25.193675 7553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.129
I20260805 22:41:25.195132 7553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.77.129
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.129
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:25.195494 7553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:25.195842 7553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:25.201342 7561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:25.201506 7553 server_base.cc:1034] running on GCE node
W20260805 22:41:25.201296 7559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:25.201298 7558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:25.201872 7553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:25.202183 7553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:25.203333 7553 hybrid_clock.cc:648] HybridClock initialized: now 1785969685203320 us; error 32 us; skew 500 ppm
I20260805 22:41:25.204718 7553 webserver.cc:460] Webserver started at http://127.19.77.129:43899/ using document root <none> and password file <none>
I20260805 22:41:25.204978 7553 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:25.205039 7553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:25.205224 7553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:25.206377 7553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/data/instance:
uuid: "d2cb3dc33dac468f890b2d69a8c6a687"
format_stamp: "Formatted at 2026-08-05 22:41:25 on dist-test-slave-chsk"
server_key: "ca7c78a23709dec10053718fad0ee359"
server_key_iv: "7d213b4e8772bb62cee6f6780fc800b4"
server_key_version: "encryptionkey@0"
I20260805 22:41:25.206760 7553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance:
uuid: "d2cb3dc33dac468f890b2d69a8c6a687"
format_stamp: "Formatted at 2026-08-05 22:41:25 on dist-test-slave-chsk"
server_key: "ca7c78a23709dec10053718fad0ee359"
server_key_iv: "7d213b4e8772bb62cee6f6780fc800b4"
server_key_version: "encryptionkey@0"
I20260805 22:41:25.208309 7553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:25.209172 7567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:25.209358 7553 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:25.209472 7553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/wal
uuid: "d2cb3dc33dac468f890b2d69a8c6a687"
format_stamp: "Formatted at 2026-08-05 22:41:25 on dist-test-slave-chsk"
server_key: "ca7c78a23709dec10053718fad0ee359"
server_key_iv: "7d213b4e8772bb62cee6f6780fc800b4"
server_key_version: "encryptionkey@0"
I20260805 22:41:25.209553 7553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:25.222720 7553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:25.223554 7553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:25.223829 7553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:25.224365 7553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:25.224830 7553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:25.224895 7553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:25.224938 7553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:25.224967 7553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:25.231495 7553 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.129:37775
I20260805 22:41:25.231591 7686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.129:37775 every 8 connection(s)
I20260805 22:41:25.231984 7553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/data/info.pb
I20260805 22:41:25.237519 7532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.232936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.129:57999 (local address 127.19.77.190:42553)
0805 22:41:25.233032 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.233034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.233211 (+ 177us) server_negotiation.cc:407] Connection header received
0805 22:41:25.233715 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.233716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.233727 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.233779 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:25.234492 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.234999 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.236084 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.236282 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.236344 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.237272 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:25.237273 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:25.237273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:25.237278 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:25.237291 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:25.237295 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:25.237339 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.237427 (+ 88us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.237450 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 22:41:25.237787 7689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.232840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42553 (local address 127.19.77.129:57999)
0805 22:41:25.233051 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:25.233098 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:25.233622 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:25.233844 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:25.233847 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:25.233856 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:25.234400 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.234404 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.235108 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.235109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.235984 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.235986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.236375 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.236376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.236497 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.237124 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:41:25.237125 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:25.237156 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:41:25.237183 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:25.237354 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:25.237359 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:25.237362 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:25.237417 (+ 55us) client_negotiation.cc:240] Negotiation successful
0805 22:41:25.237509 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":76,"threads_started":1}
I20260805 22:41:25.238374 7687 heartbeater.cc:347] Connected to a master server at 127.19.77.190:42553
I20260805 22:41:25.238502 7687 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:25.238714 7687 heartbeater.cc:511] Master 127.19.77.190:42553 requested a full tablet report, sending...
I20260805 22:41:25.239382 7492 ts_manager.cc:194] Registered new tserver with Master: d2cb3dc33dac468f890b2d69a8c6a687 (127.19.77.129:37775)
I20260805 22:41:25.240195 7492 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.129:57999
I20260805 22:41:25.240578 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 7553
I20260805 22:41:25.240715 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-0/wal/instance
I20260805 22:41:25.240929 19766 external_mini_cluster.cc:1428] Setting key e05652881d23f4eb2a795ba58724c973
I20260805 22:41:25.242024 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.130:0
--local_ip_for_outbound_sockets=127.19.77.130
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42553
--builtin_ntp_servers=127.19.77.148:43199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:41:25.331432 7690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:25.331676 7690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:25.331699 7690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:25.332890 7690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:25.332935 7690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:25.332963 7690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.130
I20260805 22:41:25.334355 7690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.77.130
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.130
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:25.334589 7690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:25.334887 7690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:25.340533 7695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:25.340682 7698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:25.340747 7690 server_base.cc:1034] running on GCE node
W20260805 22:41:25.340590 7696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:25.340996 7690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:25.341284 7690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:25.342468 7690 hybrid_clock.cc:648] HybridClock initialized: now 1785969685342445 us; error 34 us; skew 500 ppm
I20260805 22:41:25.343933 7690 webserver.cc:460] Webserver started at http://127.19.77.130:32777/ using document root <none> and password file <none>
I20260805 22:41:25.344218 7690 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:25.344295 7690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:25.344456 7690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:25.345630 7690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/data/instance:
uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef"
format_stamp: "Formatted at 2026-08-05 22:41:25 on dist-test-slave-chsk"
server_key: "21bf08b3bb33ec4b939705d23c82b35a"
server_key_iv: "fdd3f0111bae4c1b166d179264a63045"
server_key_version: "encryptionkey@0"
I20260805 22:41:25.346024 7690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance:
uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef"
format_stamp: "Formatted at 2026-08-05 22:41:25 on dist-test-slave-chsk"
server_key: "21bf08b3bb33ec4b939705d23c82b35a"
server_key_iv: "fdd3f0111bae4c1b166d179264a63045"
server_key_version: "encryptionkey@0"
I20260805 22:41:25.347509 7690 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:25.348343 7704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:25.348538 7690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:25.348634 7690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/wal
uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef"
format_stamp: "Formatted at 2026-08-05 22:41:25 on dist-test-slave-chsk"
server_key: "21bf08b3bb33ec4b939705d23c82b35a"
server_key_iv: "fdd3f0111bae4c1b166d179264a63045"
server_key_version: "encryptionkey@0"
I20260805 22:41:25.348694 7690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:25.358870 7690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:25.359287 7690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:25.359416 7690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:25.359622 7690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:25.359994 7690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:25.360030 7690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:25.360087 7690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:25.360127 7690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:25.366714 7690 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.130:41225
I20260805 22:41:25.366796 7823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.130:41225 every 8 connection(s)
I20260805 22:41:25.367132 7690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/data/info.pb
I20260805 22:41:25.368719 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 7690
I20260805 22:41:25.368853 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/wal/instance
I20260805 22:41:25.369045 19766 external_mini_cluster.cc:1428] Setting key 0b9522999119c661b9bd2ff816a89970
I20260805 22:41:25.370165 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.77.131:0
--local_ip_for_outbound_sockets=127.19.77.131
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42553
--builtin_ntp_servers=127.19.77.148:43199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:41:25.373467 7532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.368027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:39415 (local address 127.19.77.190:42553)
0805 22:41:25.368102 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.368104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.368342 (+ 238us) server_negotiation.cc:407] Connection header received
0805 22:41:25.368857 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.368859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.368872 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.368935 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:25.369765 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.370500 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.371722 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.372030 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.372112 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.373131 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:25.373133 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:25.373133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:25.373139 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:25.373157 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:25.373162 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:25.373218 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.373318 (+ 100us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.373348 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260805 22:41:25.373612 7826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.368010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42553 (local address 127.19.77.130:39415)
0805 22:41:25.368215 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:25.368251 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:25.368748 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:25.369010 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:25.369014 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:25.369022 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:25.369657 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.369662 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.370617 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.370618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.371642 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.371645 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.372144 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.372145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.372320 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.372938 (+ 618us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:41:25.372939 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:25.372980 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:41:25.373011 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:25.373233 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:25.373239 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:25.373242 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:25.373300 (+ 58us) client_negotiation.cc:240] Negotiation successful
0805 22:41:25.373391 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":109,"threads_started":1}
I20260805 22:41:25.374137 7824 heartbeater.cc:347] Connected to a master server at 127.19.77.190:42553
I20260805 22:41:25.374253 7824 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:25.374475 7824 heartbeater.cc:511] Master 127.19.77.190:42553 requested a full tablet report, sending...
I20260805 22:41:25.374897 7492 ts_manager.cc:194] Registered new tserver with Master: 6fc02d80b8d5442e9ccc66f35f1ae9ef (127.19.77.130:41225)
I20260805 22:41:25.375375 7492 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.130:39415
W20260805 22:41:25.457826 7827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:25.458066 7827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:25.458091 7827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:25.459340 7827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:25.459386 7827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:25.459414 7827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.77.131
I20260805 22:41:25.460861 7827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:43199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.77.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.77.131
--webserver_port=0
--tserver_master_addrs=127.19.77.190:42553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.77.131
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:25.461139 7827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:25.461495 7827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:25.467070 7835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:25.467031 7833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:25.467070 7832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:25.467111 7827 server_base.cc:1034] running on GCE node
I20260805 22:41:25.467434 7827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:25.467777 7827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:25.468964 7827 hybrid_clock.cc:648] HybridClock initialized: now 1785969685468954 us; error 48 us; skew 500 ppm
I20260805 22:41:25.470446 7827 webserver.cc:460] Webserver started at http://127.19.77.131:44469/ using document root <none> and password file <none>
I20260805 22:41:25.470726 7827 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:25.470806 7827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:25.470973 7827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:25.472263 7827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/data/instance:
uuid: "32376a32029e4e7bbeddea766c712d24"
format_stamp: "Formatted at 2026-08-05 22:41:25 on dist-test-slave-chsk"
server_key: "71447074dd45f689845adb71ff77588b"
server_key_iv: "102c593019aa8554bf0e52203459a1e7"
server_key_version: "encryptionkey@0"
I20260805 22:41:25.472663 7827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance:
uuid: "32376a32029e4e7bbeddea766c712d24"
format_stamp: "Formatted at 2026-08-05 22:41:25 on dist-test-slave-chsk"
server_key: "71447074dd45f689845adb71ff77588b"
server_key_iv: "102c593019aa8554bf0e52203459a1e7"
server_key_version: "encryptionkey@0"
I20260805 22:41:25.474068 7827 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:25.474807 7842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:25.474987 7827 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260805 22:41:25.475098 7827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/wal
uuid: "32376a32029e4e7bbeddea766c712d24"
format_stamp: "Formatted at 2026-08-05 22:41:25 on dist-test-slave-chsk"
server_key: "71447074dd45f689845adb71ff77588b"
server_key_iv: "102c593019aa8554bf0e52203459a1e7"
server_key_version: "encryptionkey@0"
I20260805 22:41:25.475210 7827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:25.485127 7827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:25.485492 7827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:25.485653 7827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:25.485908 7827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:41:25.486266 7827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:41:25.486325 7827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:25.486370 7827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:41:25.486394 7827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:25.492660 7827 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.131:43897
I20260805 22:41:25.492704 7960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.131:43897 every 8 connection(s)
I20260805 22:41:25.493070 7827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/data/info.pb
I20260805 22:41:25.497206 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 7827
I20260805 22:41:25.497323 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/wal/instance
I20260805 22:41:25.497553 19766 external_mini_cluster.cc:1428] Setting key 5b6e5a5ef76fdca3ae70f15bd55d72a1
I20260805 22:41:25.500098 7532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.494020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.131:49293 (local address 127.19.77.190:42553)
0805 22:41:25.494139 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.494144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.494555 (+ 411us) server_negotiation.cc:407] Connection header received
0805 22:41:25.495602 (+ 1047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.495604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.495620 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.495673 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:25.496446 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.496951 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.498396 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.498729 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.498792 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.499788 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:25.499789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:25.499790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:25.499795 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:25.499808 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:25.499812 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:25.499860 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.499999 (+ 139us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.500025 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 22:41:25.500419 7963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.493849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:42553 (local address 127.19.77.131:49293)
0805 22:41:25.494371 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:25.494417 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:25.495328 (+ 911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:25.495766 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:25.495770 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:25.495780 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:25.496329 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.496334 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.497064 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.497065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.498311 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.498315 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.498820 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.498822 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.498958 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.499650 (+ 692us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:41:25.499651 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:25.499683 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:41:25.499710 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:25.499907 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:25.499915 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:25.499918 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:25.499999 (+ 81us) client_negotiation.cc:240] Negotiation successful
0805 22:41:25.500106 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":112,"threads_started":1}
I20260805 22:41:25.500988 7961 heartbeater.cc:347] Connected to a master server at 127.19.77.190:42553
I20260805 22:41:25.501108 7961 heartbeater.cc:464] Registering TS with master...
I20260805 22:41:25.501335 7961 heartbeater.cc:511] Master 127.19.77.190:42553 requested a full tablet report, sending...
I20260805 22:41:25.501678 7492 ts_manager.cc:194] Registered new tserver with Master: 32376a32029e4e7bbeddea766c712d24 (127.19.77.131:43897)
I20260805 22:41:25.502081 7492 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.77.131:49293
I20260805 22:41:25.509706 19766 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:41:25.514384 7532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.511214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40150 (local address 127.19.77.190:42553)
0805 22:41:25.511282 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.511285 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.511406 (+ 121us) server_negotiation.cc:407] Connection header received
0805 22:41:25.511488 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.511489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.511499 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.511567 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:25.511783 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.512317 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.513097 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.513300 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.513377 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.514087 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:25.514088 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:25.514089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:25.514094 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:25.514115 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:25.514119 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:25.514177 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.514255 (+ 78us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.514278 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:41:25.515991 7492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40150:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:41:25.517634 7492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:41:25.524438 7969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.519943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.130:41225 (local address 127.0.0.1:42962)
0805 22:41:25.520125 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:25.520171 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:25.520248 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:25.520756 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:25.520761 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:25.520764 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:25.520847 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.520849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.521886 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.521887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.523026 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.523029 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.524101 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.524102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.524193 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.524209 (+ 16us) client_negotiation.cc:769] Sending connection context
0805 22:41:25.524287 (+ 78us) client_negotiation.cc:240] Negotiation successful
0805 22:41:25.524347 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":100,"threads_started":1}
I20260805 22:41:25.524712 7970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.520032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42962 (local address 127.19.77.130:41225)
0805 22:41:25.520276 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.520282 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.520294 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:41:25.520340 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.520341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.520357 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.520437 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:25.520921 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.521795 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.523121 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.524011 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.524089 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.524190 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.524582 (+ 392us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.524627 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":122,"threads_started":1}
I20260805 22:41:25.524935 7971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.520429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:37775 (local address 127.0.0.1:53836)
0805 22:41:25.520541 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:25.520553 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:25.520602 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:25.520991 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:25.520992 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:25.520994 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:25.521047 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.521048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.522459 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.522461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.523744 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.523747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.524653 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.524655 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.524712 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.524716 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:41:25.524745 (+ 29us) client_negotiation.cc:240] Negotiation successful
0805 22:41:25.524850 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":46,"threads_started":1}
I20260805 22:41:25.525323 7974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.520543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53836 (local address 127.19.77.129:37775)
0805 22:41:25.520738 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.520742 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.520753 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:41:25.520790 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.520792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.520806 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.520889 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:25.521135 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.522330 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.523854 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.524540 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.525040 (+ 500us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.525144 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.525172 (+ 28us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.525225 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":124,"threads_started":1}
I20260805 22:41:25.525514 7972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.520306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50700 (local address 127.19.77.131:43897)
0805 22:41:25.521002 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.521012 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.521020 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:41:25.521051 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.521052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.521064 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.521162 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:25.521249 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.522358 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.523794 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.524488 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.524560 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.525366 (+ 806us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.525395 (+ 29us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.525437 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":95,"threads_started":1}
I20260805 22:41:25.525157 7973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.520184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:43897 (local address 127.0.0.1:50700)
0805 22:41:25.520510 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:25.520521 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:25.520576 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:25.521158 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:25.521159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:25.521160 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:25.521190 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.521192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.522445 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.522446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.523678 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.523682 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.524913 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.524914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.524990 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.524995 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:41:25.525045 (+ 50us) client_negotiation.cc:240] Negotiation successful
0805 22:41:25.525093 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":42,"thread_start_us":51,"threads_started":1}
I20260805 22:41:25.525651 7757 tablet_service.cc:1467] Processing CreateTablet for tablet f3861a4292f44d2fb1ce0a05431e0393 (DEFAULT_TABLE table=test-table [id=774f866a2f614e97bd10d046a10df577]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:25.525959 7616 tablet_service.cc:1467] Processing CreateTablet for tablet f3861a4292f44d2fb1ce0a05431e0393 (DEFAULT_TABLE table=test-table [id=774f866a2f614e97bd10d046a10df577]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:25.526081 7757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3861a4292f44d2fb1ce0a05431e0393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:25.526310 7616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3861a4292f44d2fb1ce0a05431e0393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:25.526232 7893 tablet_service.cc:1467] Processing CreateTablet for tablet f3861a4292f44d2fb1ce0a05431e0393 (DEFAULT_TABLE table=test-table [id=774f866a2f614e97bd10d046a10df577]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:41:25.526533 7893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3861a4292f44d2fb1ce0a05431e0393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:25.529371 7976 tablet_bootstrap.cc:492] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687: Bootstrap starting.
I20260805 22:41:25.529861 7977 tablet_bootstrap.cc:492] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: Bootstrap starting.
I20260805 22:41:25.530139 7978 tablet_bootstrap.cc:492] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: Bootstrap starting.
I20260805 22:41:25.530284 7976 tablet_bootstrap.cc:654] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:25.530581 7977 tablet_bootstrap.cc:654] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:25.530587 7976 log.cc:824] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:25.530812 7978 tablet_bootstrap.cc:654] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:25.530954 7977 log.cc:824] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:25.531219 7978 log.cc:824] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:25.531461 7976 tablet_bootstrap.cc:492] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687: No bootstrap required, opened a new log
I20260805 22:41:25.531543 7976 ts_tablet_manager.cc:1397] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:41:25.531769 7977 tablet_bootstrap.cc:492] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: No bootstrap required, opened a new log
I20260805 22:41:25.531845 7977 ts_tablet_manager.cc:1397] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260805 22:41:25.533532 7976 raft_consensus.cc:348] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41225 } } peers { permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 } } peers { permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 } }
I20260805 22:41:25.533684 7976 raft_consensus.cc:374] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:25.533706 7976 raft_consensus.cc:729] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cb3dc33dac468f890b2d69a8c6a687, State: Initialized, Role: FOLLOWER
I20260805 22:41:25.533836 7976 consensus_queue.cc:260] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41225 } } peers { permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 } } peers { permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 } }
I20260805 22:41:25.533790 7977 raft_consensus.cc:348] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41225 } } peers { permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 } } peers { permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 } }
I20260805 22:41:25.533955 7977 raft_consensus.cc:374] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:25.534001 7977 raft_consensus.cc:729] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc02d80b8d5442e9ccc66f35f1ae9ef, State: Initialized, Role: FOLLOWER
I20260805 22:41:25.534132 7976 ts_tablet_manager.cc:1428] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 22:41:25.534128 7977 consensus_queue.cc:260] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41225 } } peers { permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 } } peers { permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 } }
I20260805 22:41:25.534202 7687 heartbeater.cc:503] Master 127.19.77.190:42553 was elected leader, sending a full tablet report...
I20260805 22:41:25.534412 7977 ts_tablet_manager.cc:1428] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260805 22:41:25.534511 7824 heartbeater.cc:503] Master 127.19.77.190:42553 was elected leader, sending a full tablet report...
I20260805 22:41:25.535259 7978 tablet_bootstrap.cc:492] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: No bootstrap required, opened a new log
I20260805 22:41:25.535344 7978 ts_tablet_manager.cc:1397] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260805 22:41:25.537559 7978 raft_consensus.cc:348] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41225 } } peers { permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 } } peers { permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 } }
I20260805 22:41:25.537734 7978 raft_consensus.cc:374] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:25.537787 7978 raft_consensus.cc:729] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32376a32029e4e7bbeddea766c712d24, State: Initialized, Role: FOLLOWER
I20260805 22:41:25.537918 7978 consensus_queue.cc:260] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41225 } } peers { permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 } } peers { permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 } }
I20260805 22:41:25.538203 7978 ts_tablet_manager.cc:1428] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260805 22:41:25.538290 7961 heartbeater.cc:503] Master 127.19.77.190:42553 was elected leader, sending a full tablet report...
W20260805 22:41:25.617810 7825 tablet.cc:2369] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:41:25.718969 7983 raft_consensus.cc:482] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:41:25.719118 7983 raft_consensus.cc:504] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41225 } } peers { permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 } } peers { permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 } }
I20260805 22:41:25.719527 7983 leader_election.cc:288] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32376a32029e4e7bbeddea766c712d24 (127.19.77.131:43897), d2cb3dc33dac468f890b2d69a8c6a687 (127.19.77.129:37775)
I20260805 22:41:25.722486 7972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.719871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:50595 (local address 127.19.77.131:43897)
0805 22:41:25.719954 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.719957 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.719970 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:41:25.720012 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.720013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.720024 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.720089 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:25.720262 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.720740 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.721722 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.722114 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.722203 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.722213 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.722368 (+ 155us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.722410 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:41:25.722494 7826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.719787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.131:43897 (local address 127.19.77.130:50595)
0805 22:41:25.719841 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:25.719854 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:25.719942 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:25.720101 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:25.720103 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:25.720104 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:25.720183 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.720185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.720834 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.720836 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.721619 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.721621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.722216 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.722217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.722291 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.722294 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:25.722362 (+ 68us) client_negotiation.cc:240] Negotiation successful
0805 22:41:25.722410 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260805 22:41:25.722636 7974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.720059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.77.130:43689 (local address 127.19.77.129:37775)
0805 22:41:25.720112 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.720114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.720193 (+ 79us) server_negotiation.cc:407] Connection header received
0805 22:41:25.720272 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.720273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.720285 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.720357 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:41:25.720513 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.720976 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.721913 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.722283 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.722368 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.722376 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.722526 (+ 150us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.722564 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:41:25.722702 7985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.719908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:37775 (local address 127.19.77.130:43689)
0805 22:41:25.720117 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:25.720127 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:25.720205 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:25.720360 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:25.720361 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:25.720362 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:41:25.720442 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.720444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.721068 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.721069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.721820 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:25.721822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.722368 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.722369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:25.722448 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.722451 (+ 3us) client_negotiation.cc:769] Sending connection context
0805 22:41:25.722519 (+ 68us) client_negotiation.cc:240] Negotiation successful
0805 22:41:25.722567 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":134,"threads_started":1}
I20260805 22:41:25.722869 7913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3861a4292f44d2fb1ce0a05431e0393" candidate_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32376a32029e4e7bbeddea766c712d24" is_pre_election: true
I20260805 22:41:25.723057 7913 raft_consensus.cc:2454] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc02d80b8d5442e9ccc66f35f1ae9ef in term 0.
I20260805 22:41:25.723418 7705 leader_election.cc:302] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32376a32029e4e7bbeddea766c712d24, 6fc02d80b8d5442e9ccc66f35f1ae9ef; no voters:
I20260805 22:41:25.723508 7639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3861a4292f44d2fb1ce0a05431e0393" candidate_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" is_pre_election: true
I20260805 22:41:25.723663 7639 raft_consensus.cc:2454] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc02d80b8d5442e9ccc66f35f1ae9ef in term 0.
I20260805 22:41:25.723641 7983 raft_consensus.cc:2781] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:41:25.723716 7983 raft_consensus.cc:482] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:41:25.723740 7983 raft_consensus.cc:3037] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:25.724629 7983 raft_consensus.cc:504] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41225 } } peers { permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 } } peers { permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 } }
I20260805 22:41:25.724785 7983 leader_election.cc:288] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [CANDIDATE]: Term 1 election: Requested vote from peers 32376a32029e4e7bbeddea766c712d24 (127.19.77.131:43897), d2cb3dc33dac468f890b2d69a8c6a687 (127.19.77.129:37775)
I20260805 22:41:25.724990 7913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3861a4292f44d2fb1ce0a05431e0393" candidate_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32376a32029e4e7bbeddea766c712d24"
I20260805 22:41:25.725010 7639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3861a4292f44d2fb1ce0a05431e0393" candidate_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cb3dc33dac468f890b2d69a8c6a687"
I20260805 22:41:25.725078 7639 raft_consensus.cc:3037] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:25.725090 7913 raft_consensus.cc:3037] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:25.725822 7639 raft_consensus.cc:2454] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc02d80b8d5442e9ccc66f35f1ae9ef in term 1.
I20260805 22:41:25.725971 7913 raft_consensus.cc:2454] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc02d80b8d5442e9ccc66f35f1ae9ef in term 1.
I20260805 22:41:25.725992 7705 leader_election.cc:302] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc02d80b8d5442e9ccc66f35f1ae9ef, d2cb3dc33dac468f890b2d69a8c6a687; no voters:
I20260805 22:41:25.726097 7983 raft_consensus.cc:2781] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:25.726260 7983 raft_consensus.cc:686] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 1 LEADER]: Becoming Leader. State: Replica: 6fc02d80b8d5442e9ccc66f35f1ae9ef, State: Running, Role: LEADER
I20260805 22:41:25.726365 7983 consensus_queue.cc:237] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41225 } } peers { permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 } } peers { permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 } }
I20260805 22:41:25.727305 7492 catalog_manager.cc:5495] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fc02d80b8d5442e9ccc66f35f1ae9ef (127.19.77.130). New cstate: current_term: 1 leader_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc02d80b8d5442e9ccc66f35f1ae9ef" member_type: VOTER last_known_addr { host: "127.19.77.130" port: 41225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 } health_report { overall_health: UNKNOWN } } }
W20260805 22:41:25.732933 7688 tablet.cc:2369] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:41:25.743705 7962 tablet.cc:2369] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:41:25.751210 7970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.748638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42972 (local address 127.19.77.130:41225)
0805 22:41:25.748708 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:25.748710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:25.748726 (+ 16us) server_negotiation.cc:407] Connection header received
0805 22:41:25.748766 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:25.748767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:25.748787 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:25.748868 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:25.749035 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.749520 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.750308 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:25.750509 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:25.750587 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:25.750777 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:25.750885 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:25.750980 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:25.751029 (+ 49us) server_negotiation.cc:299] Negotiation successful
0805 22:41:25.751049 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 22:41:25.753365 7639 raft_consensus.cc:1261] T f3861a4292f44d2fb1ce0a05431e0393 P d2cb3dc33dac468f890b2d69a8c6a687 [term 1 FOLLOWER]: Refusing update from remote peer 6fc02d80b8d5442e9ccc66f35f1ae9ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:25.753394 7913 raft_consensus.cc:1261] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24 [term 1 FOLLOWER]: Refusing update from remote peer 6fc02d80b8d5442e9ccc66f35f1ae9ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:25.753787 7986 consensus_queue.cc:1035] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "32376a32029e4e7bbeddea766c712d24" member_type: VOTER last_known_addr { host: "127.19.77.131" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:25.753938 7983 consensus_queue.cc:1035] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cb3dc33dac468f890b2d69a8c6a687" member_type: VOTER last_known_addr { host: "127.19.77.129" port: 37775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:25.756387 7989 mvcc.cc:205] Tried to move back new op lower bound from 7315331832842534912 to 7315331832735772672. Current Snapshot: MvccSnapshot[applied={T|T < 7315331832842534912}]
I20260805 22:41:25.756511 7990 mvcc.cc:205] Tried to move back new op lower bound from 7315331832842534912 to 7315331832735772672. Current Snapshot: MvccSnapshot[applied={T|T < 7315331832842534912}]
I20260805 22:41:25.759222 7492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:25.759346 7492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:41:25.760324 7492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77ccb3d867e6472a90927f339ed3f492: Sending DeleteTablet for 3 replicas of tablet f3861a4292f44d2fb1ce0a05431e0393
I20260805 22:41:25.760764 7893 tablet_service.cc:1514] Processing DeleteTablet for tablet f3861a4292f44d2fb1ce0a05431e0393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:25 UTC) from {username='slave'} at 127.0.0.1:50700
I20260805 22:41:25.760772 7757 tablet_service.cc:1514] Processing DeleteTablet for tablet f3861a4292f44d2fb1ce0a05431e0393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:25 UTC) from {username='slave'} at 127.0.0.1:42962
I20260805 22:41:25.760807 7616 tablet_service.cc:1514] Processing DeleteTablet for tablet f3861a4292f44d2fb1ce0a05431e0393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:41:25 UTC) from {username='slave'} at 127.0.0.1:53836
I20260805 22:41:25.761042 8002 tablet_replica.cc:330] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: stopping tablet replica
I20260805 22:41:25.761159 8002 raft_consensus.cc:2229] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:41:25.761291 8002 raft_consensus.cc:2258] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:25.761467 8001 tablet_replica.cc:330] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: stopping tablet replica
I20260805 22:41:25.761533 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 7553
I20260805 22:41:25.761579 8001 raft_consensus.cc:2229] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:41:25.761688 8001 raft_consensus.cc:2258] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:41:25.761798 8002 ts_tablet_manager.cc:1905] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:25.763586 8002 ts_tablet_manager.cc:1918] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:25.763743 8002 log.cc:1196] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-1/wal/wals/f3861a4292f44d2fb1ce0a05431e0393
I20260805 22:41:25.764134 8002 ts_tablet_manager.cc:1939] T f3861a4292f44d2fb1ce0a05431e0393 P 6fc02d80b8d5442e9ccc66f35f1ae9ef: Deleting consensus metadata
I20260805 22:41:25.764667 7475 catalog_manager.cc:4841] TS 6fc02d80b8d5442e9ccc66f35f1ae9ef (127.19.77.130:41225): tablet f3861a4292f44d2fb1ce0a05431e0393 (table test-table [id=774f866a2f614e97bd10d046a10df577]) successfully deleted
I20260805 22:41:25.764773 8001 ts_tablet_manager.cc:1905] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:41:25.766861 8001 ts_tablet_manager.cc:1918] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:41:25.766958 8001 log.cc:1196] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: Deleting WAL directory at /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785969428667539-19766-0/minicluster-data/ts-2/wal/wals/f3861a4292f44d2fb1ce0a05431e0393
I20260805 22:41:25.767251 8001 ts_tablet_manager.cc:1939] T f3861a4292f44d2fb1ce0a05431e0393 P 32376a32029e4e7bbeddea766c712d24: Deleting consensus metadata
I20260805 22:41:25.767745 7475 catalog_manager.cc:4841] TS 32376a32029e4e7bbeddea766c712d24 (127.19.77.131:43897): tablet f3861a4292f44d2fb1ce0a05431e0393 (table test-table [id=774f866a2f614e97bd10d046a10df577]) successfully deleted
W20260805 22:41:25.770570 7475 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.77.129:37775 (error 108)
I20260805 22:41:25.770787 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 7690
I20260805 22:41:25.772285 7973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:25.772114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.129:37775 (local address 127.0.0.1:53852)
0805 22:41:25.772190 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:25.772243 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.129:37775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260805 22:41:25.772585 7475 catalog_manager.cc:4584] TS d2cb3dc33dac468f890b2d69a8c6a687 (127.19.77.129:37775): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f3861a4292f44d2fb1ce0a05431e0393: Network error: Client connection negotiation failed: client connection to 127.19.77.129:37775: connect: Connection refused (error 111)
I20260805 22:41:25.780308 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 7827
I20260805 22:41:25.787719 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 7460
2026-08-05T22:41:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (929 ms)
[----------] 6 tests from EncryptionPolicyTest (8860 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:25 dist-test-slave-chsk krb5kdc[8007](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:25 dist-test-slave-chsk krb5kdc[8007](info): set up 2 sockets
Aug 05 22:41:25 dist-test-slave-chsk krb5kdc[8007](info): commencing operation
krb5kdc: starting...
W20260805 22:41:26.863127 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:26 dist-test-slave-chsk krb5kdc[8007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:26.998500 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36329
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:27.084470 8020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:27.084717 8020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:27.084743 8020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:27.086059 8020 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:27.086122 8020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:27.086138 8020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:27.086151 8020 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:27.086164 8020 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:27.087898 8020 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36329
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:27.088234 8020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:27.088510 8020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:27.093914 8025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:27.093899 8028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:27.093899 8026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:27.093938 8020 server_base.cc:1034] running on GCE node
I20260805 22:41:27.094520 8020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:27.094890 8020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:27.096083 8020 hybrid_clock.cc:648] HybridClock initialized: now 1785969687096061 us; error 31 us; skew 500 ppm
Aug 05 22:41:27 dist-test-slave-chsk krb5kdc[8007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969687, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:27.098779 8020 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:27.099355 8020 webserver.cc:460] Webserver started at http://127.0.0.1:36653/ using document root <none> and password file <none>
I20260805 22:41:27.099617 8020 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:27.099695 8020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:27.099872 8020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:27.101058 8020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "b1d4605db64c4873a388440ce0929004"
format_stamp: "Formatted at 2026-08-05 22:41:27 on dist-test-slave-chsk"
server_key: "77a36b09c0ff1d7ccf1d55e4ab3774ce"
server_key_iv: "7bc53a1353754daa86f001f5b4f97401"
server_key_version: "encryptionkey@0"
I20260805 22:41:27.101465 8020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "b1d4605db64c4873a388440ce0929004"
format_stamp: "Formatted at 2026-08-05 22:41:27 on dist-test-slave-chsk"
server_key: "77a36b09c0ff1d7ccf1d55e4ab3774ce"
server_key_iv: "7bc53a1353754daa86f001f5b4f97401"
server_key_version: "encryptionkey@0"
I20260805 22:41:27.103051 8020 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:27.103981 8035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:27.104210 8020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:27.104349 8020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "b1d4605db64c4873a388440ce0929004"
format_stamp: "Formatted at 2026-08-05 22:41:27 on dist-test-slave-chsk"
server_key: "77a36b09c0ff1d7ccf1d55e4ab3774ce"
server_key_iv: "7bc53a1353754daa86f001f5b4f97401"
server_key_version: "encryptionkey@0"
I20260805 22:41:27.104434 8020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:27.120777 8020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:27.122936 8020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:27.123128 8020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:27.127800 8020 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36329
I20260805 22:41:27.127856 8089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36329 every 8 connection(s)
I20260805 22:41:27.128319 8020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:27.129271 8090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:27.132025 8090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004: Bootstrap starting.
I20260805 22:41:27.132642 8090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:27.132910 8090 log.cc:824] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:27.133812 8090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004: No bootstrap required, opened a new log
I20260805 22:41:27.134987 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 8020
I20260805 22:41:27.135142 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:27.135363 19766 external_mini_cluster.cc:1428] Setting key 5d894123ead53756e5377fce811d5ee4
I20260805 22:41:27.135730 8090 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1d4605db64c4873a388440ce0929004" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36329 } }
I20260805 22:41:27.135957 8090 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:27.136055 8090 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d4605db64c4873a388440ce0929004, State: Initialized, Role: FOLLOWER
I20260805 22:41:27.136242 8090 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1d4605db64c4873a388440ce0929004" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36329 } }
I20260805 22:41:27.136339 8090 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:27.136371 8090 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:27.136412 8090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:27.137617 8090 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1d4605db64c4873a388440ce0929004" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36329 } }
I20260805 22:41:27.137741 8090 leader_election.cc:302] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1d4605db64c4873a388440ce0929004; no voters:
I20260805 22:41:27.137917 8090 leader_election.cc:288] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:27.137979 8095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:27.138176 8095 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [term 1 LEADER]: Becoming Leader. State: Replica: b1d4605db64c4873a388440ce0929004, State: Running, Role: LEADER
I20260805 22:41:27.138267 8090 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:27.138288 8095 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1d4605db64c4873a388440ce0929004" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36329 } }
I20260805 22:41:27.138640 8095 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1d4605db64c4873a388440ce0929004. Latest consensus state: current_term: 1 leader_uuid: "b1d4605db64c4873a388440ce0929004" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1d4605db64c4873a388440ce0929004" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36329 } } }
I20260805 22:41:27.138649 8096 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1d4605db64c4873a388440ce0929004" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1d4605db64c4873a388440ce0929004" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36329 } } }
I20260805 22:41:27.139863 8095 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:27.139922 8096 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004 [sys.catalog]: This master's current role is: LEADER
W20260805 22:41:27.140283 8111 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:41:27.140343 8111 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:41:27.140403 8113 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:27.140549 8113 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:27.142467 8113 catalog_manager.cc:1347] Generated new cluster ID: e43e7c484bf14dfa9c7f93b7335acb18
I20260805 22:41:27.142536 8113 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:41:27 dist-test-slave-chsk krb5kdc[8007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:41:27.147967 8094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:27.136003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45499 (local address 127.0.0.1:36329)
0805 22:41:27.136219 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:27.136230 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:27.136262 (+ 32us) server_negotiation.cc:407] Connection header received
0805 22:41:27.136383 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:27.136392 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:27.136454 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:27.136602 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:27.137263 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:27.138679 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:27.139793 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:27.140447 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:27.140573 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:27.143530 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:27.143534 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:27.143534 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:27.143549 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:27.145783 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:27.146233 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:27.146237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:27.146237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:27.146365 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:27.146614 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:27.146615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:27.146615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:27.146903 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:27.147627 (+ 724us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:27.147704 (+ 77us) server_negotiation.cc:299] Negotiation successful
0805 22:41:27.147796 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
I20260805 22:41:27.149189 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:27.154474 8113 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:27.155247 8113 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:27.157572 8094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:27.150678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57705 (local address 127.0.0.1:36329)
0805 22:41:27.150728 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:27.150730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:27.150853 (+ 123us) server_negotiation.cc:407] Connection header received
0805 22:41:27.150933 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:27.150934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:27.150944 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:27.150989 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:27.151651 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:27.152170 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:27.152904 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:27.153148 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:27.153226 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:27.154820 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:27.154821 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:27.154821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:27.154829 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:27.156364 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:27.156761 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:27.156763 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:27.156764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:27.156824 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:27.157055 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:27.157056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:27.157056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:27.157173 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:27.157285 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:27.157400 (+ 115us) server_negotiation.cc:299] Negotiation successful
0805 22:41:27.157467 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260805 22:41:27.164819 8113 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1d4605db64c4873a388440ce0929004: Generated new TSK 0
I20260805 22:41:27.165400 8113 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:27.169770 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 8020
W20260805 22:41:27.175987 8005 connection.cc:535] client connection to 127.0.0.1:36329 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36329): Connection reset by peer (error 104)
2026-08-05T22:41:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1380 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:27 dist-test-slave-chsk krb5kdc[8122](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:27 dist-test-slave-chsk krb5kdc[8122](info): set up 2 sockets
Aug 05 22:41:27 dist-test-slave-chsk krb5kdc[8122](info): commencing operation
krb5kdc: starting...
W20260805 22:41:28.236093 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:28 dist-test-slave-chsk krb5kdc[8122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:28.382565 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40061
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:28.471223 8137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:28.471508 8137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:28.471552 8137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:28.472796 8137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:28.472879 8137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:28.472904 8137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:28.472926 8137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:28.472956 8137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:28.474568 8137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40061
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:28.474884 8137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:28.475172 8137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:28.480473 8144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:28.480621 8137 server_base.cc:1034] running on GCE node
W20260805 22:41:28.480491 8146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:28.480496 8142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:28.481034 8137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:28.481760 8137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:28.483129 8137 hybrid_clock.cc:648] HybridClock initialized: now 1785969688483088 us; error 53 us; skew 500 ppm
Aug 05 22:41:28 dist-test-slave-chsk krb5kdc[8122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969688, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:28.486117 8137 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:28.486673 8137 webserver.cc:460] Webserver started at http://127.0.0.1:34171/ using document root <none> and password file <none>
I20260805 22:41:28.486919 8137 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:28.486991 8137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:28.487208 8137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:28.488348 8137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "5cce0f97ce3a4e47b78126d7515b0e57"
format_stamp: "Formatted at 2026-08-05 22:41:28 on dist-test-slave-chsk"
server_key: "d1d49ecd26a41a32a4aeec0b9116afa4"
server_key_iv: "6132c0b145ff7148c109e716f72ff0cd"
server_key_version: "encryptionkey@0"
I20260805 22:41:28.488742 8137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "5cce0f97ce3a4e47b78126d7515b0e57"
format_stamp: "Formatted at 2026-08-05 22:41:28 on dist-test-slave-chsk"
server_key: "d1d49ecd26a41a32a4aeec0b9116afa4"
server_key_iv: "6132c0b145ff7148c109e716f72ff0cd"
server_key_version: "encryptionkey@0"
I20260805 22:41:28.490247 8137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:28.491103 8153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:28.491341 8137 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:41:28.491446 8137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "5cce0f97ce3a4e47b78126d7515b0e57"
format_stamp: "Formatted at 2026-08-05 22:41:28 on dist-test-slave-chsk"
server_key: "d1d49ecd26a41a32a4aeec0b9116afa4"
server_key_iv: "6132c0b145ff7148c109e716f72ff0cd"
server_key_version: "encryptionkey@0"
I20260805 22:41:28.491537 8137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:28.507953 8137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:28.510452 8137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:28.510632 8137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:28.515132 8137 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40061
I20260805 22:41:28.515195 8207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40061 every 8 connection(s)
I20260805 22:41:28.515648 8137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:28.516573 8209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:28.519099 8209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57: Bootstrap starting.
I20260805 22:41:28.519177 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 8137
I20260805 22:41:28.519297 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:28.519524 19766 external_mini_cluster.cc:1428] Setting key fbfeb4e70c8e30188e84c621bb3c858e
I20260805 22:41:28.519964 8209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:28.520342 8209 log.cc:824] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:28.521174 8209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57: No bootstrap required, opened a new log
I20260805 22:41:28.523728 8209 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cce0f97ce3a4e47b78126d7515b0e57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40061 } }
I20260805 22:41:28.523942 8209 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:28.523976 8209 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cce0f97ce3a4e47b78126d7515b0e57, State: Initialized, Role: FOLLOWER
I20260805 22:41:28.524103 8209 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cce0f97ce3a4e47b78126d7515b0e57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40061 } }
I20260805 22:41:28.524180 8209 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:28.524211 8209 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:28.524256 8209 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:28.525036 8209 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cce0f97ce3a4e47b78126d7515b0e57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40061 } }
I20260805 22:41:28.525170 8209 leader_election.cc:302] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cce0f97ce3a4e47b78126d7515b0e57; no voters:
I20260805 22:41:28.525382 8209 leader_election.cc:288] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:28.525424 8214 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:28.525646 8214 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [term 1 LEADER]: Becoming Leader. State: Replica: 5cce0f97ce3a4e47b78126d7515b0e57, State: Running, Role: LEADER
I20260805 22:41:28.525681 8209 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:28.525748 8214 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cce0f97ce3a4e47b78126d7515b0e57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40061 } }
I20260805 22:41:28.526052 8214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cce0f97ce3a4e47b78126d7515b0e57. Latest consensus state: current_term: 1 leader_uuid: "5cce0f97ce3a4e47b78126d7515b0e57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cce0f97ce3a4e47b78126d7515b0e57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40061 } } }
I20260805 22:41:28.526178 8214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:28.526448 8212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:28.520117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52843 (local address 127.0.0.1:40061)
0805 22:41:28.520342 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:28.520353 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:28.520387 (+ 34us) server_negotiation.cc:407] Connection header received
0805 22:41:28.521022 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:28.521041 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:28.521104 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:28.521268 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:28.521506 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:28.522920 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:28.523795 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:28.524428 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:28.524548 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:28.525304 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:28.525308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:28.525309 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:28.525536 (+ 227us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:28.525589 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:28.525604 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:28.525974 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:28.526020 (+ 46us) server_negotiation.cc:299] Negotiation successful
0805 22:41:28.526059 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":91,"threads_started":1}
I20260805 22:41:28.526064 8215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cce0f97ce3a4e47b78126d7515b0e57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cce0f97ce3a4e47b78126d7515b0e57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40061 } } }
I20260805 22:41:28.526588 8215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:28.526438 8221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:28.527314 8221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:28.527498 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:28.528824 8221 catalog_manager.cc:1347] Generated new cluster ID: 2f0e22eee3f548d49070aa5d5c85538e
I20260805 22:41:28.528877 8221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:28.533026 8212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:28.529210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50415 (local address 127.0.0.1:40061)
0805 22:41:28.529247 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:28.529249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:28.529535 (+ 286us) server_negotiation.cc:407] Connection header received
0805 22:41:28.529564 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:28.529565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:28.529576 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:28.529647 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:28.529782 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:28.530541 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:28.531565 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:28.531909 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:28.531991 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:28.532752 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:28.532753 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:28.532754 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:28.532759 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:28.532777 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:28.532782 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:28.532851 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:28.532926 (+ 75us) server_negotiation.cc:299] Negotiation successful
0805 22:41:28.532938 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:41:28.534601 8221 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:28.535334 8221 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:28.539940 8221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5cce0f97ce3a4e47b78126d7515b0e57: Generated new TSK 0
I20260805 22:41:28.540138 8221 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:28.544615 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 8137
W20260805 22:41:28.550443 8120 connection.cc:535] client connection to 127.0.0.1:40061 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40061): Connection reset by peer (error 104)
2026-08-05T22:41:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1374 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:28 dist-test-slave-chsk krb5kdc[8241](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:28 dist-test-slave-chsk krb5kdc[8241](info): set up 2 sockets
Aug 05 22:41:28 dist-test-slave-chsk krb5kdc[8241](info): commencing operation
krb5kdc: starting...
W20260805 22:41:29.598994 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:29 dist-test-slave-chsk krb5kdc[8241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:29.733984 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43661
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43661
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:29.819959 8254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:29.820201 8254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:29.820228 8254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:29.821532 8254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:29.821601 8254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:29.821616 8254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:29.821630 8254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:29.821642 8254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:29.823398 8254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43661
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:29.823730 8254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:29.824002 8254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:29.829221 8259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:29.829316 8260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:29.829366 8254 server_base.cc:1034] running on GCE node
W20260805 22:41:29.829454 8262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:29.829754 8254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:29.830123 8254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:29.831291 8254 hybrid_clock.cc:648] HybridClock initialized: now 1785969689831274 us; error 48 us; skew 500 ppm
Aug 05 22:41:29 dist-test-slave-chsk krb5kdc[8241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969689, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:29.833997 8254 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:29.834551 8254 webserver.cc:460] Webserver started at http://127.0.0.1:41553/ using document root <none> and password file <none>
I20260805 22:41:29.834800 8254 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:29.834873 8254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:29.835041 8254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:29.836230 8254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7"
format_stamp: "Formatted at 2026-08-05 22:41:29 on dist-test-slave-chsk"
server_key: "926b7a2d0c7b245a3f15839467345a59"
server_key_iv: "6b5e44b8a4d3f49c02b96429acdbb515"
server_key_version: "encryptionkey@0"
I20260805 22:41:29.836634 8254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7"
format_stamp: "Formatted at 2026-08-05 22:41:29 on dist-test-slave-chsk"
server_key: "926b7a2d0c7b245a3f15839467345a59"
server_key_iv: "6b5e44b8a4d3f49c02b96429acdbb515"
server_key_version: "encryptionkey@0"
I20260805 22:41:29.838089 8254 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:29.838925 8269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:29.839200 8254 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:29.839305 8254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7"
format_stamp: "Formatted at 2026-08-05 22:41:29 on dist-test-slave-chsk"
server_key: "926b7a2d0c7b245a3f15839467345a59"
server_key_iv: "6b5e44b8a4d3f49c02b96429acdbb515"
server_key_version: "encryptionkey@0"
I20260805 22:41:29.839394 8254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:29.842973 8254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:29.845145 8254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:29.845328 8254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:29.849879 8254 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43661
I20260805 22:41:29.849917 8325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43661 every 8 connection(s)
I20260805 22:41:29.850307 8254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:29.850735 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 8254
I20260805 22:41:29.850884 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:29.851105 19766 external_mini_cluster.cc:1428] Setting key b841500726510e70153fa9be4d1e7073
I20260805 22:41:29.851462 8326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:29.854135 8329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:29.851748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38375 (local address 127.0.0.1:43661)
0805 22:41:29.851972 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:29.851982 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:29.852019 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:41:29.852714 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:29.852723 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:29.852767 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:29.852958 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:29.853643 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:29.853646 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:29.853646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:29.853650 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:29.853703 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:29.853714 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:29.853774 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:29.853867 (+ 93us) server_negotiation.cc:299] Negotiation successful
0805 22:41:29.853902 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":106,"threads_started":1}
I20260805 22:41:29.855259 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:29.855494 8326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7: Bootstrap starting.
I20260805 22:41:29.856139 8326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:29.856459 8326 log.cc:824] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:29.857414 8326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7: No bootstrap required, opened a new log
I20260805 22:41:29.857873 8329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:29.856859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52367 (local address 127.0.0.1:43661)
0805 22:41:29.856916 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:29.856918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:29.857015 (+ 97us) server_negotiation.cc:407] Connection header received
0805 22:41:29.857083 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:29.857084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:29.857089 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:29.857140 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:29.857698 (+ 558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:29.857699 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:29.857699 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:29.857702 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:29.857715 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:29.857719 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:29.857761 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:29.857815 (+ 54us) server_negotiation.cc:299] Negotiation successful
0805 22:41:29.857826 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260805 22:41:29.859727 8326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43661 } }
I20260805 22:41:29.859886 8326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:29.859910 8326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd41bb43d8b432aacfe7bc480ef8fe7, State: Initialized, Role: FOLLOWER
I20260805 22:41:29.860067 8326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43661 } }
I20260805 22:41:29.860149 8326 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:29.860173 8326 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:29.860204 8326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:29.860898 8326 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43661 } }
I20260805 22:41:29.861017 8326 leader_election.cc:302] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bd41bb43d8b432aacfe7bc480ef8fe7; no voters:
I20260805 22:41:29.861238 8326 leader_election.cc:288] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:29.861308 8336 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:29.861527 8336 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd41bb43d8b432aacfe7bc480ef8fe7, State: Running, Role: LEADER
I20260805 22:41:29.861539 8326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:29.861639 8336 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43661 } }
I20260805 22:41:29.862121 8338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bd41bb43d8b432aacfe7bc480ef8fe7. Latest consensus state: current_term: 1 leader_uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43661 } } }
I20260805 22:41:29.862221 8338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:29.862593 8337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd41bb43d8b432aacfe7bc480ef8fe7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43661 } } }
I20260805 22:41:29.862690 8337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7 [sys.catalog]: This master's current role is: LEADER
W20260805 22:41:29.863533 8353 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:41:29.863603 8353 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:41:29.863696 8344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:29.863900 8344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:29.866006 8344 catalog_manager.cc:1347] Generated new cluster ID: 658bae0809c244a197b736e4bdf6cc2d
I20260805 22:41:29.866079 8344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:29.877303 8344 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:29.877512 8344 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:29.881536 8344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3bd41bb43d8b432aacfe7bc480ef8fe7: Generated new TSK 0
I20260805 22:41:29.881757 8344 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:29.883560 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 8254
2026-08-05T22:41:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1339 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:29 dist-test-slave-chsk krb5kdc[8358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:29 dist-test-slave-chsk krb5kdc[8358](info): set up 2 sockets
Aug 05 22:41:29 dist-test-slave-chsk krb5kdc[8358](info): commencing operation
krb5kdc: starting...
W20260805 22:41:30.943496 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:31 dist-test-slave-chsk krb5kdc[8358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:31.075503 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45359
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:31.162362 8371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:31.162611 8371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:31.162637 8371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:31.164023 8371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:31.164093 8371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:31.164108 8371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:31.164121 8371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:31.164134 8371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:31.165880 8371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:31.166190 8371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:31.166483 8371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:31.171749 8377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:31.171761 8379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:31.171742 8376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:31.172071 8371 server_base.cc:1034] running on GCE node
I20260805 22:41:31.172312 8371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:31.172633 8371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:31.173804 8371 hybrid_clock.cc:648] HybridClock initialized: now 1785969691173786 us; error 35 us; skew 500 ppm
Aug 05 22:41:31 dist-test-slave-chsk krb5kdc[8358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969691, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:31.176673 8371 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:31.177191 8371 webserver.cc:460] Webserver started at http://127.0.0.1:46859/ using document root <none> and password file <none>
I20260805 22:41:31.177481 8371 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:31.177558 8371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:31.177722 8371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:31.178890 8371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "46f9a47bc6014486ad9909fc11770802"
format_stamp: "Formatted at 2026-08-05 22:41:31 on dist-test-slave-chsk"
server_key: "0756694edfa57da56e983e8684bc3c2f"
server_key_iv: "44daacf9451c76088111ccdbe76fe812"
server_key_version: "encryptionkey@0"
I20260805 22:41:31.179332 8371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "46f9a47bc6014486ad9909fc11770802"
format_stamp: "Formatted at 2026-08-05 22:41:31 on dist-test-slave-chsk"
server_key: "0756694edfa57da56e983e8684bc3c2f"
server_key_iv: "44daacf9451c76088111ccdbe76fe812"
server_key_version: "encryptionkey@0"
I20260805 22:41:31.181128 8371 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260805 22:41:31.182027 8386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:31.182315 8371 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:31.182446 8371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "46f9a47bc6014486ad9909fc11770802"
format_stamp: "Formatted at 2026-08-05 22:41:31 on dist-test-slave-chsk"
server_key: "0756694edfa57da56e983e8684bc3c2f"
server_key_iv: "44daacf9451c76088111ccdbe76fe812"
server_key_version: "encryptionkey@0"
I20260805 22:41:31.182539 8371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:31.193502 8371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:31.195749 8371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:31.195937 8371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:31.200384 8371 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45359
I20260805 22:41:31.200534 8440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45359 every 8 connection(s)
I20260805 22:41:31.200865 8371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:31.201861 8441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:31.201989 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 8371
I20260805 22:41:31.202126 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:31.202353 19766 external_mini_cluster.cc:1428] Setting key 2d7c4364f58f578f44b214acae961605
I20260805 22:41:31.205542 8441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802: Bootstrap starting.
I20260805 22:41:31.206414 8441 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:31.206750 8441 log.cc:824] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:31.207674 8441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802: No bootstrap required, opened a new log
Aug 05 22:41:31 dist-test-slave-chsk krb5kdc[8358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:41:31.210386 8441 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f9a47bc6014486ad9909fc11770802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } }
I20260805 22:41:31.210556 8441 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:31.210582 8441 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f9a47bc6014486ad9909fc11770802, State: Initialized, Role: FOLLOWER
I20260805 22:41:31.210760 8441 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f9a47bc6014486ad9909fc11770802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } }
I20260805 22:41:31.210826 8441 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:31.210848 8441 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:31.210922 8441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:31.211635 8441 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f9a47bc6014486ad9909fc11770802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } }
I20260805 22:41:31.211771 8441 leader_election.cc:302] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46f9a47bc6014486ad9909fc11770802; no voters:
I20260805 22:41:31.212019 8441 leader_election.cc:288] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:31.212055 8446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:31.212198 8446 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [term 1 LEADER]: Becoming Leader. State: Replica: 46f9a47bc6014486ad9909fc11770802, State: Running, Role: LEADER
I20260805 22:41:31.212291 8446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f9a47bc6014486ad9909fc11770802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } }
I20260805 22:41:31.212345 8441 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:31.212639 8446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46f9a47bc6014486ad9909fc11770802. Latest consensus state: current_term: 1 leader_uuid: "46f9a47bc6014486ad9909fc11770802" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f9a47bc6014486ad9909fc11770802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } } }
I20260805 22:41:31.212657 8447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46f9a47bc6014486ad9909fc11770802" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f9a47bc6014486ad9909fc11770802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } } }
I20260805 22:41:31.212808 8446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:31.212857 8447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:31.213133 8455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:31.213737 8455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:31.215238 8444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:31.202960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50775 (local address 127.0.0.1:45359)
0805 22:41:31.203203 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:31.203223 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:31.203264 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:41:31.203726 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:31.203734 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:31.203784 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:31.203906 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:31.204750 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:31.205657 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:31.206916 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:31.207466 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:31.207560 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:31.210370 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:31.210375 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:31.210375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:31.210388 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:31.212859 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:31.213365 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:31.213385 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:31.213385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:31.213511 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:31.213747 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:31.213748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:31.213748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:31.214180 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:31.214758 (+ 578us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:31.214833 (+ 75us) server_negotiation.cc:299] Negotiation successful
0805 22:41:31.214996 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":95,"threads_started":1}
I20260805 22:41:31.215673 8455 catalog_manager.cc:1347] Generated new cluster ID: 60b56300b8434ff3970794da199bd3a0
I20260805 22:41:31.215730 8455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:31.220203 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:31.228598 8444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:31.221793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34997 (local address 127.0.0.1:45359)
0805 22:41:31.221841 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:31.221843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:31.221984 (+ 141us) server_negotiation.cc:407] Connection header received
0805 22:41:31.222058 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:31.222059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:31.222070 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:31.222121 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:31.222718 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:31.223333 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:31.224072 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:31.224312 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:31.224390 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:31.225731 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:31.225733 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:31.225734 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:31.225742 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:31.227332 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:31.227714 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:31.227715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:31.227716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:31.227781 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:31.227992 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:31.227994 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:31.227994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:31.228129 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:31.228235 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:31.228396 (+ 161us) server_negotiation.cc:299] Negotiation successful
0805 22:41:31.228480 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":13,"server-negotiator.queue_time_us":24}
I20260805 22:41:31.230850 8455 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:31.231469 8455 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:31.239840 8455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46f9a47bc6014486ad9909fc11770802: Generated new TSK 0
I20260805 22:41:31.240211 8455 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:31.243404 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 8371
2026-08-05T22:41:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1359 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:31 dist-test-slave-chsk krb5kdc[8474](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:31 dist-test-slave-chsk krb5kdc[8474](info): set up 2 sockets
Aug 05 22:41:31 dist-test-slave-chsk krb5kdc[8474](info): commencing operation
krb5kdc: starting...
W20260805 22:41:32.314776 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:32 dist-test-slave-chsk krb5kdc[8474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:32.445974 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35089
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:32.533028 8489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:32.533319 8489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:32.533365 8489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:32.534909 8489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:32.535027 8489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:32.535058 8489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:32.535091 8489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:32.535161 8489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:32.536947 8489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:32.537283 8489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:32.537549 8489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:32.542865 8495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:32.542865 8494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:32.543058 8497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:32.543115 8489 server_base.cc:1034] running on GCE node
I20260805 22:41:32.543380 8489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:32.543653 8489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:32.544866 8489 hybrid_clock.cc:648] HybridClock initialized: now 1785969692544837 us; error 45 us; skew 500 ppm
Aug 05 22:41:32 dist-test-slave-chsk krb5kdc[8474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969692, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:32.552415 8489 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:32.552930 8489 webserver.cc:460] Webserver started at http://127.0.0.1:46433/ using document root <none> and password file <none>
I20260805 22:41:32.553215 8489 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:32.553290 8489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:32.553447 8489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:32.554593 8489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "38ddd774b91c47fda0c8da9728ec1ef2"
format_stamp: "Formatted at 2026-08-05 22:41:32 on dist-test-slave-chsk"
server_key: "c3e3c61cd4acba423cb6ec657b91f03a"
server_key_iv: "6da91d2ff38c5cf329f9c450965b1e9f"
server_key_version: "encryptionkey@0"
I20260805 22:41:32.554992 8489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "38ddd774b91c47fda0c8da9728ec1ef2"
format_stamp: "Formatted at 2026-08-05 22:41:32 on dist-test-slave-chsk"
server_key: "c3e3c61cd4acba423cb6ec657b91f03a"
server_key_iv: "6da91d2ff38c5cf329f9c450965b1e9f"
server_key_version: "encryptionkey@0"
I20260805 22:41:32.556604 8489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:32.557536 8505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:32.557734 8489 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:32.557853 8489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "38ddd774b91c47fda0c8da9728ec1ef2"
format_stamp: "Formatted at 2026-08-05 22:41:32 on dist-test-slave-chsk"
server_key: "c3e3c61cd4acba423cb6ec657b91f03a"
server_key_iv: "6da91d2ff38c5cf329f9c450965b1e9f"
server_key_version: "encryptionkey@0"
I20260805 22:41:32.557938 8489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:32.570982 8489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:32.573736 8489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:32.573963 8489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:32.578258 8489 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35089
I20260805 22:41:32.578342 8560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35089 every 8 connection(s)
I20260805 22:41:32.578744 8489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:32.579769 8561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:32.582136 8561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2: Bootstrap starting.
I20260805 22:41:32.582230 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 8489
I20260805 22:41:32.582370 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:32.582572 19766 external_mini_cluster.cc:1428] Setting key e9c9ec36fe869068169cc64f51bbda10
I20260805 22:41:32.582906 8561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:32.583323 8561 log.cc:824] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:32.584141 8561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2: No bootstrap required, opened a new log
I20260805 22:41:32.586618 8561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ddd774b91c47fda0c8da9728ec1ef2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } }
I20260805 22:41:32.586769 8561 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:32.586792 8561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ddd774b91c47fda0c8da9728ec1ef2, State: Initialized, Role: FOLLOWER
I20260805 22:41:32.586941 8561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ddd774b91c47fda0c8da9728ec1ef2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } }
I20260805 22:41:32.587023 8561 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:32.587052 8561 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:32.587087 8561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:32.587916 8561 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ddd774b91c47fda0c8da9728ec1ef2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } }
I20260805 22:41:32.588052 8561 leader_election.cc:302] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38ddd774b91c47fda0c8da9728ec1ef2; no voters:
I20260805 22:41:32.588248 8561 leader_election.cc:288] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:32.588280 8567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:32.588402 8567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [term 1 LEADER]: Becoming Leader. State: Replica: 38ddd774b91c47fda0c8da9728ec1ef2, State: Running, Role: LEADER
I20260805 22:41:32.588546 8561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:32.588539 8567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ddd774b91c47fda0c8da9728ec1ef2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } }
I20260805 22:41:32.589107 8569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38ddd774b91c47fda0c8da9728ec1ef2. Latest consensus state: current_term: 1 leader_uuid: "38ddd774b91c47fda0c8da9728ec1ef2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ddd774b91c47fda0c8da9728ec1ef2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } } }
I20260805 22:41:32.589273 8569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:32.589275 8564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:32.583228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44809 (local address 127.0.0.1:35089)
0805 22:41:32.583467 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:32.583477 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:32.583522 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:41:32.584143 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:32.584152 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:32.584218 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:32.584374 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:32.584622 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:32.586040 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:32.586876 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:32.587525 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:32.587649 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:32.588404 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:32.588409 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:32.588410 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:32.588631 (+ 221us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:32.588698 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:32.588715 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:32.588781 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:32.588884 (+ 103us) server_negotiation.cc:299] Negotiation successful
0805 22:41:32.588963 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":98,"threads_started":1}
I20260805 22:41:32.589082 8568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38ddd774b91c47fda0c8da9728ec1ef2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ddd774b91c47fda0c8da9728ec1ef2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } } }
I20260805 22:41:32.589530 8568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:32.589696 8576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:32.590186 8576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:32.590350 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:32.595079 8564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:32.592231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34691 (local address 127.0.0.1:35089)
0805 22:41:32.592284 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:32.592287 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:32.592331 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:41:32.592395 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:32.592396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:32.592406 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:32.592450 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:32.592605 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:32.593097 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:32.593808 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:32.594040 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:32.594120 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:32.594835 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:32.594836 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:32.594836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:32.594841 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:32.594856 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:32.594860 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:32.594907 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:32.594964 (+ 57us) server_negotiation.cc:299] Negotiation successful
0805 22:41:32.594992 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260805 22:41:32.596470 8576 catalog_manager.cc:1347] Generated new cluster ID: 43b15be9204f435e8d74f712497b5d30
I20260805 22:41:32.596553 8576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:32.620853 8576 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:32.621445 8576 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:32.626200 8576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38ddd774b91c47fda0c8da9728ec1ef2: Generated new TSK 0
I20260805 22:41:32.626431 8576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:32.630205 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 8489
2026-08-05T22:41:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1386 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:32 dist-test-slave-chsk krb5kdc[8594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:32 dist-test-slave-chsk krb5kdc[8594](info): set up 2 sockets
Aug 05 22:41:32 dist-test-slave-chsk krb5kdc[8594](info): commencing operation
krb5kdc: starting...
W20260805 22:41:33.698910 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:33 dist-test-slave-chsk krb5kdc[8594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:33.832432 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36877
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:33.918913 8607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:33.919212 8607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:33.919265 8607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:33.920552 8607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:33.920642 8607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:33.920671 8607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:33.920701 8607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:33.920730 8607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:33.922400 8607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:33.922739 8607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:33.923012 8607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:33.928273 8616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:33.928273 8614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:33.928474 8607 server_base.cc:1034] running on GCE node
W20260805 22:41:33.928277 8613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:33.929006 8607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:33.929368 8607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:33.930536 8607 hybrid_clock.cc:648] HybridClock initialized: now 1785969693930512 us; error 42 us; skew 500 ppm
Aug 05 22:41:33 dist-test-slave-chsk krb5kdc[8594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969693, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:33.933447 8607 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:33.933950 8607 webserver.cc:460] Webserver started at http://127.0.0.1:45645/ using document root <none> and password file <none>
I20260805 22:41:33.934393 8607 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:33.934491 8607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:33.934674 8607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:33.935914 8607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "656082c8ad5541f5b8abb07c7f7c2cb8"
format_stamp: "Formatted at 2026-08-05 22:41:33 on dist-test-slave-chsk"
server_key: "249731296a08265616797fc3037c3f29"
server_key_iv: "015775e79c599d4d94236b302c4b62b3"
server_key_version: "encryptionkey@0"
I20260805 22:41:33.936322 8607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "656082c8ad5541f5b8abb07c7f7c2cb8"
format_stamp: "Formatted at 2026-08-05 22:41:33 on dist-test-slave-chsk"
server_key: "249731296a08265616797fc3037c3f29"
server_key_iv: "015775e79c599d4d94236b302c4b62b3"
server_key_version: "encryptionkey@0"
I20260805 22:41:33.937845 8607 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260805 22:41:33.938730 8623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:33.939095 8607 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:33.939427 8607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "656082c8ad5541f5b8abb07c7f7c2cb8"
format_stamp: "Formatted at 2026-08-05 22:41:33 on dist-test-slave-chsk"
server_key: "249731296a08265616797fc3037c3f29"
server_key_iv: "015775e79c599d4d94236b302c4b62b3"
server_key_version: "encryptionkey@0"
I20260805 22:41:33.939563 8607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:33.943480 8607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:33.946005 8607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:33.946188 8607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:33.950826 8607 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36877
I20260805 22:41:33.950897 8678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36877 every 8 connection(s)
I20260805 22:41:33.951344 8607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:33.952385 8679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:33.954784 8679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8: Bootstrap starting.
I20260805 22:41:33.955516 8679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:33.955775 8679 log.cc:824] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:33.956529 8679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8: No bootstrap required, opened a new log
I20260805 22:41:33.958209 8679 raft_consensus.cc:348] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656082c8ad5541f5b8abb07c7f7c2cb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36877 } }
I20260805 22:41:33.958369 8679 raft_consensus.cc:374] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:33.958392 8679 raft_consensus.cc:729] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 656082c8ad5541f5b8abb07c7f7c2cb8, State: Initialized, Role: FOLLOWER
I20260805 22:41:33.958552 8679 consensus_queue.cc:260] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656082c8ad5541f5b8abb07c7f7c2cb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36877 } }
I20260805 22:41:33.958639 8679 raft_consensus.cc:388] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:33.958674 8679 raft_consensus.cc:482] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:33.958664 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 8607
I20260805 22:41:33.958750 8679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:33.958834 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:33.959017 19766 external_mini_cluster.cc:1428] Setting key 0ebd1b0340220c7c3c5355e929561503
I20260805 22:41:33.959591 8679 raft_consensus.cc:504] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656082c8ad5541f5b8abb07c7f7c2cb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36877 } }
I20260805 22:41:33.959720 8679 leader_election.cc:302] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 656082c8ad5541f5b8abb07c7f7c2cb8; no voters:
I20260805 22:41:33.959950 8679 leader_election.cc:288] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:33.959977 8685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:33.960139 8685 raft_consensus.cc:686] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [term 1 LEADER]: Becoming Leader. State: Replica: 656082c8ad5541f5b8abb07c7f7c2cb8, State: Running, Role: LEADER
I20260805 22:41:33.960228 8685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656082c8ad5541f5b8abb07c7f7c2cb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36877 } }
I20260805 22:41:33.960296 8679 sys_catalog.cc:564] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:33.960566 8687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 656082c8ad5541f5b8abb07c7f7c2cb8. Latest consensus state: current_term: 1 leader_uuid: "656082c8ad5541f5b8abb07c7f7c2cb8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656082c8ad5541f5b8abb07c7f7c2cb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36877 } } }
I20260805 22:41:33.960695 8687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:33.960566 8686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "656082c8ad5541f5b8abb07c7f7c2cb8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656082c8ad5541f5b8abb07c7f7c2cb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36877 } } }
I20260805 22:41:33.960906 8689 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:33.960904 8686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:33.961493 8689 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:33.962167 8684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:33.959597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55811 (local address 127.0.0.1:36877)
0805 22:41:33.959892 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:33.959901 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:33.959930 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:41:33.960068 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:33.960077 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:33.960116 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:33.961085 (+ 969us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:33.961418 (+ 333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:33.961421 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:33.961421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:33.961425 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:33.961473 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:33.961488 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:33.961789 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:33.961823 (+ 34us) server_negotiation.cc:299] Negotiation successful
0805 22:41:33.961866 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":143,"threads_started":1}
I20260805 22:41:33.963277 8702 mvcc.cc:205] Tried to move back new op lower bound from 7315331866471669760 to 7315331866461450240. Current Snapshot: MvccSnapshot[applied={T|T < 7315331866471669760}]
I20260805 22:41:33.963425 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:33.963693 8689 catalog_manager.cc:1347] Generated new cluster ID: d0ad5091289a4b489d998974247d1cfb
I20260805 22:41:33.963737 8689 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:33.966292 8684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:33.965006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48053 (local address 127.0.0.1:36877)
0805 22:41:33.965113 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:33.965115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:33.965264 (+ 149us) server_negotiation.cc:407] Connection header received
0805 22:41:33.965314 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:33.965315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:33.965340 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:33.965405 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:33.966078 (+ 673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:33.966079 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:33.966079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:33.966083 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:33.966096 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:33.966100 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:33.966148 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:33.966212 (+ 64us) server_negotiation.cc:299] Negotiation successful
0805 22:41:33.966225 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 22:41:33.981361 8689 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:33.981602 8689 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:33.990110 8689 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 656082c8ad5541f5b8abb07c7f7c2cb8: Generated new TSK 0
I20260805 22:41:33.990373 8689 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:33.995090 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 8607
2026-08-05T22:41:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1365 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:34 dist-test-slave-chsk krb5kdc[8713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:34 dist-test-slave-chsk krb5kdc[8713](info): set up 2 sockets
Aug 05 22:41:34 dist-test-slave-chsk krb5kdc[8713](info): commencing operation
krb5kdc: starting...
W20260805 22:41:35.055598 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:35 dist-test-slave-chsk krb5kdc[8713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:35.189818 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44271
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44271
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:35.277770 8727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:35.278007 8727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:35.278043 8727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:35.279393 8727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:35.279452 8727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:35.279467 8727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:35.279480 8727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:35.279510 8727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:35.281159 8727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:35.281457 8727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:35.281721 8727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:35.286911 8732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:35.286908 8735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:35.286906 8733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:35.287235 8727 server_base.cc:1034] running on GCE node
I20260805 22:41:35.287482 8727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:35.287820 8727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:35.289044 8727 hybrid_clock.cc:648] HybridClock initialized: now 1785969695289029 us; error 44 us; skew 500 ppm
Aug 05 22:41:35 dist-test-slave-chsk krb5kdc[8713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969695, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:35.291927 8727 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:35.292487 8727 webserver.cc:460] Webserver started at http://127.0.0.1:34089/ using document root <none> and password file <none>
I20260805 22:41:35.292738 8727 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:35.292810 8727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:35.292972 8727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:35.294152 8727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "e48e60bed5dd449b9ba41acbabc6630f"
format_stamp: "Formatted at 2026-08-05 22:41:35 on dist-test-slave-chsk"
server_key: "c3d2e5036d295918526c046cddc5b5ef"
server_key_iv: "1ee680e5dbdbfc0a6ad4e672266feca7"
server_key_version: "encryptionkey@0"
I20260805 22:41:35.294565 8727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "e48e60bed5dd449b9ba41acbabc6630f"
format_stamp: "Formatted at 2026-08-05 22:41:35 on dist-test-slave-chsk"
server_key: "c3d2e5036d295918526c046cddc5b5ef"
server_key_iv: "1ee680e5dbdbfc0a6ad4e672266feca7"
server_key_version: "encryptionkey@0"
I20260805 22:41:35.296360 8727 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260805 22:41:35.297305 8742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:35.297675 8727 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:35.297806 8727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "e48e60bed5dd449b9ba41acbabc6630f"
format_stamp: "Formatted at 2026-08-05 22:41:35 on dist-test-slave-chsk"
server_key: "c3d2e5036d295918526c046cddc5b5ef"
server_key_iv: "1ee680e5dbdbfc0a6ad4e672266feca7"
server_key_version: "encryptionkey@0"
I20260805 22:41:35.297899 8727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:35.325546 8727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:35.328596 8727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:35.328812 8727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:35.333531 8727 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44271
I20260805 22:41:35.333570 8795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44271 every 8 connection(s)
I20260805 22:41:35.333962 8727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:35.334887 8796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:35.336499 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 8727
I20260805 22:41:35.336638 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:35.336879 19766 external_mini_cluster.cc:1428] Setting key e9f8cf294703733278462e46f7ef9fc5
I20260805 22:41:35.337901 8796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f: Bootstrap starting.
I20260805 22:41:35.338620 8796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:35.339012 8796 log.cc:824] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:35.340027 8796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f: No bootstrap required, opened a new log
I20260805 22:41:35.342603 8796 raft_consensus.cc:348] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48e60bed5dd449b9ba41acbabc6630f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44271 } }
I20260805 22:41:35.342811 8796 raft_consensus.cc:374] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:35.342856 8796 raft_consensus.cc:729] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e48e60bed5dd449b9ba41acbabc6630f, State: Initialized, Role: FOLLOWER
I20260805 22:41:35.343031 8796 consensus_queue.cc:260] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48e60bed5dd449b9ba41acbabc6630f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44271 } }
I20260805 22:41:35.343128 8796 raft_consensus.cc:388] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:35.343195 8796 raft_consensus.cc:482] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:35.343253 8796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:35.344189 8796 raft_consensus.cc:504] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48e60bed5dd449b9ba41acbabc6630f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44271 } }
I20260805 22:41:35.344295 8796 leader_election.cc:302] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e48e60bed5dd449b9ba41acbabc6630f; no voters:
I20260805 22:41:35.344522 8796 leader_election.cc:288] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:35.344548 8801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:35.344671 8801 raft_consensus.cc:686] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [term 1 LEADER]: Becoming Leader. State: Replica: e48e60bed5dd449b9ba41acbabc6630f, State: Running, Role: LEADER
Aug 05 22:41:35 dist-test-slave-chsk krb5kdc[8713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:41:35.344769 8801 consensus_queue.cc:237] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48e60bed5dd449b9ba41acbabc6630f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44271 } }
I20260805 22:41:35.344837 8796 sys_catalog.cc:564] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:35.345213 8802 sys_catalog.cc:455] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e48e60bed5dd449b9ba41acbabc6630f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48e60bed5dd449b9ba41acbabc6630f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44271 } } }
I20260805 22:41:35.345489 8802 sys_catalog.cc:458] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:35.345408 8803 sys_catalog.cc:455] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e48e60bed5dd449b9ba41acbabc6630f. Latest consensus state: current_term: 1 leader_uuid: "e48e60bed5dd449b9ba41acbabc6630f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48e60bed5dd449b9ba41acbabc6630f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44271 } } }
I20260805 22:41:35.345798 8803 sys_catalog.cc:458] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:35.346640 8805 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:35.347303 8805 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:35.349339 8805 catalog_manager.cc:1347] Generated new cluster ID: 3b0531b2595a44eeba9703a644166aeb
I20260805 22:41:35.349395 8805 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:35.350529 8799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:35.337511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:41081 (local address 127.0.0.1:44271)
0805 22:41:35.337693 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:35.337702 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:35.337728 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:41:35.338208 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:35.338215 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:35.338272 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:35.338394 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:35.339344 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:35.340487 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:35.341601 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:35.342046 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:35.342140 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:35.345558 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:35.345564 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:35.345564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:35.345579 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:35.348034 (+ 2455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:35.348613 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:35.348616 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:35.348617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:35.348735 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:35.349045 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:35.349046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:35.349046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:35.349378 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:35.349552 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:35.350139 (+ 587us) server_negotiation.cc:299] Negotiation successful
0805 22:41:35.350266 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
I20260805 22:41:35.352289 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:35.363336 8799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:35.353887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:50793 (local address 127.0.0.1:44271)
0805 22:41:35.353925 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:35.353927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:35.355346 (+ 1419us) server_negotiation.cc:407] Connection header received
0805 22:41:35.355387 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:35.355389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:35.355403 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:35.355475 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:35.356164 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:35.356980 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:35.358029 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:35.358392 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:35.358477 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:35.360112 (+ 1635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:35.360114 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:35.360115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:35.360123 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:35.361855 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:35.362364 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:35.362365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:35.362365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:35.362434 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:35.362676 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:35.362676 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:35.362677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:35.362822 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:35.362953 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:35.363102 (+ 149us) server_negotiation.cc:299] Negotiation successful
0805 22:41:35.363230 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:41:35.368141 8805 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:35.368705 8805 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:35.372233 8805 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e48e60bed5dd449b9ba41acbabc6630f: Generated new TSK 0
I20260805 22:41:35.372476 8805 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:35.375245 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 8727
W20260805 22:41:35.381289 8711 connection.cc:535] client connection to 127.0.0.1:44271 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44271): Connection reset by peer (error 104)
2026-08-05T22:41:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1379 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:35 dist-test-slave-chsk krb5kdc[8829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:35 dist-test-slave-chsk krb5kdc[8829](info): set up 2 sockets
Aug 05 22:41:35 dist-test-slave-chsk krb5kdc[8829](info): commencing operation
krb5kdc: starting...
W20260805 22:41:36.455469 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:36 dist-test-slave-chsk krb5kdc[8829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:36.582363 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43081
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:36.668907 8843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:36.669150 8843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:36.669175 8843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:36.670311 8843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:36.670353 8843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:36.670368 8843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:36.670382 8843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:36.670393 8843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:36.671983 8843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:36.672222 8843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:36.672415 8843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:36.677340 8848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:36.677335 8849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:36.677374 8851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:36.677763 8843 server_base.cc:1034] running on GCE node
I20260805 22:41:36.678042 8843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:36.678418 8843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:36.679620 8843 hybrid_clock.cc:648] HybridClock initialized: now 1785969696679572 us; error 40 us; skew 500 ppm
Aug 05 22:41:36 dist-test-slave-chsk krb5kdc[8829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969696, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:36.682557 8843 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:36.683009 8843 webserver.cc:460] Webserver started at http://127.0.0.1:38917/ using document root <none> and password file <none>
I20260805 22:41:36.683301 8843 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:36.683352 8843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:36.683456 8843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:36.684556 8843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "48e125e0ddd646d78bc20a552fb62528"
format_stamp: "Formatted at 2026-08-05 22:41:36 on dist-test-slave-chsk"
server_key: "f26d16e0582fb6ce995d860ba5ddf707"
server_key_iv: "ad770b1e978329cc88ec27dbab4a408b"
server_key_version: "encryptionkey@0"
I20260805 22:41:36.685039 8843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "48e125e0ddd646d78bc20a552fb62528"
format_stamp: "Formatted at 2026-08-05 22:41:36 on dist-test-slave-chsk"
server_key: "f26d16e0582fb6ce995d860ba5ddf707"
server_key_iv: "ad770b1e978329cc88ec27dbab4a408b"
server_key_version: "encryptionkey@0"
I20260805 22:41:36.686517 8843 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:36.687372 8858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:36.687551 8843 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:36.687640 8843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "48e125e0ddd646d78bc20a552fb62528"
format_stamp: "Formatted at 2026-08-05 22:41:36 on dist-test-slave-chsk"
server_key: "f26d16e0582fb6ce995d860ba5ddf707"
server_key_iv: "ad770b1e978329cc88ec27dbab4a408b"
server_key_version: "encryptionkey@0"
I20260805 22:41:36.687706 8843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:36.710842 8843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:36.713382 8843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:36.713569 8843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:36.718528 8843 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43081
I20260805 22:41:36.718568 8912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43081 every 8 connection(s)
I20260805 22:41:36.718966 8843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:36.719978 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:36.722450 8913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528: Bootstrap starting.
I20260805 22:41:36.723102 8913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:36.723455 8913 log.cc:824] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:36.724299 8913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528: No bootstrap required, opened a new log
I20260805 22:41:36.726020 8913 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e125e0ddd646d78bc20a552fb62528" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } }
I20260805 22:41:36.726207 8913 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:36.726261 8913 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48e125e0ddd646d78bc20a552fb62528, State: Initialized, Role: FOLLOWER
I20260805 22:41:36.726464 8913 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e125e0ddd646d78bc20a552fb62528" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } }
I20260805 22:41:36.726572 8913 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:36.726617 8913 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:36.726671 8913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:36.727324 8913 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e125e0ddd646d78bc20a552fb62528" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } }
I20260805 22:41:36.727455 8913 leader_election.cc:302] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48e125e0ddd646d78bc20a552fb62528; no voters:
I20260805 22:41:36.727670 8913 leader_election.cc:288] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:36.727720 8916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:36.727921 8916 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [term 1 LEADER]: Becoming Leader. State: Replica: 48e125e0ddd646d78bc20a552fb62528, State: Running, Role: LEADER
I20260805 22:41:36.728003 8913 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:36.728012 8916 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e125e0ddd646d78bc20a552fb62528" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } }
I20260805 22:41:36.728518 8917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48e125e0ddd646d78bc20a552fb62528" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e125e0ddd646d78bc20a552fb62528" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } } }
I20260805 22:41:36.728627 8917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:36.728725 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 8843
I20260805 22:41:36.728749 8918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48e125e0ddd646d78bc20a552fb62528. Latest consensus state: current_term: 1 leader_uuid: "48e125e0ddd646d78bc20a552fb62528" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e125e0ddd646d78bc20a552fb62528" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43081 } } }
I20260805 22:41:36.728876 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:36.728880 8925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:36.728950 8918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:36.729090 19766 external_mini_cluster.cc:1428] Setting key d8473cca72059ce4b377ac218ff7dd2d
I20260805 22:41:36.729483 8925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:36.731175 8925 catalog_manager.cc:1347] Generated new cluster ID: 0603e10ad63c47068c434a7e7719c169
I20260805 22:41:36.731237 8925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:36.736442 8935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:36.729652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:44495 (local address 127.0.0.1:43081)
0805 22:41:36.730063 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:36.730073 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:36.730482 (+ 409us) server_negotiation.cc:407] Connection header received
0805 22:41:36.730765 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:36.730775 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:36.730843 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:36.730986 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:36.731224 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:36.732657 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:36.733866 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:36.734546 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:36.735104 (+ 558us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:36.735521 (+ 417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:36.735525 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:36.735525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:36.735767 (+ 242us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:36.735807 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:36.735823 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:36.736117 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:36.736179 (+ 62us) server_negotiation.cc:299] Negotiation successful
0805 22:41:36.736207 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":85,"threads_started":1}
I20260805 22:41:36.737524 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:36.744055 8935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:36.739231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:37063 (local address 127.0.0.1:43081)
0805 22:41:36.739277 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:36.739280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:36.739290 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:36.739317 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:36.739318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:36.739331 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:36.739407 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:36.739563 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:36.741078 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:36.742201 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:36.742560 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:36.742610 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:36.743736 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:36.743738 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:36.743738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:36.743745 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:36.743761 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:36.743766 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:36.743799 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:36.743946 (+ 147us) server_negotiation.cc:299] Negotiation successful
0805 22:41:36.743963 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:41:36.750406 8925 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:36.751205 8925 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:36.762496 8925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48e125e0ddd646d78bc20a552fb62528: Generated new TSK 0
I20260805 22:41:36.762733 8925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:36.765445 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 8843
W20260805 22:41:36.772694 8826 connection.cc:535] client connection to 127.0.0.1:43081 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43081): Connection reset by peer (error 104)
2026-08-05T22:41:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1392 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:36 dist-test-slave-chsk krb5kdc[8946](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:36 dist-test-slave-chsk krb5kdc[8946](info): set up 2 sockets
Aug 05 22:41:36 dist-test-slave-chsk krb5kdc[8946](info): commencing operation
krb5kdc: starting...
W20260805 22:41:37.826979 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:37 dist-test-slave-chsk krb5kdc[8946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:37.958935 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41129
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:38.044494 8959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:38.044781 8959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:38.044823 8959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:38.046070 8959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:38.046161 8959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:38.046185 8959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:38.046207 8959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:38.046238 8959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:38.047899 8959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:38.048238 8959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:38.048509 8959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:41:38.053984 8959 server_base.cc:1034] running on GCE node
W20260805 22:41:38.053886 8965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:38.053874 8967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:38.053874 8964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:38.054368 8959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:38.054754 8959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:38.055958 8959 hybrid_clock.cc:648] HybridClock initialized: now 1785969698055940 us; error 45 us; skew 500 ppm
Aug 05 22:41:38 dist-test-slave-chsk krb5kdc[8946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969698, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:38.064033 8959 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:38.064617 8959 webserver.cc:460] Webserver started at http://127.0.0.1:44589/ using document root <none> and password file <none>
I20260805 22:41:38.064874 8959 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:38.064919 8959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:38.065018 8959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:38.066144 8959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "d932b9fa299e4a7b9205d653f8a7a4a3"
format_stamp: "Formatted at 2026-08-05 22:41:38 on dist-test-slave-chsk"
server_key: "ef00931d098655a816902aa68c0c0c2d"
server_key_iv: "2269d51865e9796bc3ed66d51bdecbc8"
server_key_version: "encryptionkey@0"
I20260805 22:41:38.066535 8959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "d932b9fa299e4a7b9205d653f8a7a4a3"
format_stamp: "Formatted at 2026-08-05 22:41:38 on dist-test-slave-chsk"
server_key: "ef00931d098655a816902aa68c0c0c2d"
server_key_iv: "2269d51865e9796bc3ed66d51bdecbc8"
server_key_version: "encryptionkey@0"
I20260805 22:41:38.068109 8959 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:38.068979 8974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:38.069221 8959 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:41:38.069322 8959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "d932b9fa299e4a7b9205d653f8a7a4a3"
format_stamp: "Formatted at 2026-08-05 22:41:38 on dist-test-slave-chsk"
server_key: "ef00931d098655a816902aa68c0c0c2d"
server_key_iv: "2269d51865e9796bc3ed66d51bdecbc8"
server_key_version: "encryptionkey@0"
I20260805 22:41:38.069387 8959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:38.072901 8959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:38.075388 8959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:38.075510 8959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:38.079613 8959 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41129
I20260805 22:41:38.079770 9029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41129 every 8 connection(s)
I20260805 22:41:38.080091 8959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:38.081020 9030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:38.083498 9030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3: Bootstrap starting.
I20260805 22:41:38.084259 9030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:38.084561 9030 log.cc:824] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:38.085145 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 8959
I20260805 22:41:38.085266 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:38.085474 19766 external_mini_cluster.cc:1428] Setting key c52ab93723ac7f823cba008ca6262607
I20260805 22:41:38.085474 9030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3: No bootstrap required, opened a new log
I20260805 22:41:38.087605 9030 raft_consensus.cc:348] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d932b9fa299e4a7b9205d653f8a7a4a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } }
I20260805 22:41:38.087797 9030 raft_consensus.cc:374] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:38.087843 9030 raft_consensus.cc:729] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d932b9fa299e4a7b9205d653f8a7a4a3, State: Initialized, Role: FOLLOWER
I20260805 22:41:38.088011 9030 consensus_queue.cc:260] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d932b9fa299e4a7b9205d653f8a7a4a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } }
I20260805 22:41:38.088121 9030 raft_consensus.cc:388] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:38.088147 9030 raft_consensus.cc:482] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:38.088219 9030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:38.089054 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:38.086079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:39851 (local address 127.0.0.1:41129)
0805 22:41:38.086262 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:38.086278 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:38.086306 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:41:38.087578 (+ 1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:38.087585 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:38.087617 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:38.087750 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:38.088521 (+ 771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:38.088524 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:38.088525 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:38.088529 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:38.088581 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:38.088600 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:38.088682 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:38.088748 (+ 66us) server_negotiation.cc:299] Negotiation successful
0805 22:41:38.088806 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
I20260805 22:41:38.089533 9030 raft_consensus.cc:504] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d932b9fa299e4a7b9205d653f8a7a4a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } }
I20260805 22:41:38.089653 9030 leader_election.cc:302] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d932b9fa299e4a7b9205d653f8a7a4a3; no voters:
I20260805 22:41:38.089841 9030 leader_election.cc:288] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:38.089874 9035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:38.089982 9035 raft_consensus.cc:686] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [term 1 LEADER]: Becoming Leader. State: Replica: d932b9fa299e4a7b9205d653f8a7a4a3, State: Running, Role: LEADER
I20260805 22:41:38.090070 9035 consensus_queue.cc:237] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d932b9fa299e4a7b9205d653f8a7a4a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } }
I20260805 22:41:38.090113 9030 sys_catalog.cc:564] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:38.090250 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:38.090430 9035 sys_catalog.cc:455] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d932b9fa299e4a7b9205d653f8a7a4a3. Latest consensus state: current_term: 1 leader_uuid: "d932b9fa299e4a7b9205d653f8a7a4a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d932b9fa299e4a7b9205d653f8a7a4a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } } }
I20260805 22:41:38.090514 9035 sys_catalog.cc:458] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:38.090443 9036 sys_catalog.cc:455] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d932b9fa299e4a7b9205d653f8a7a4a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d932b9fa299e4a7b9205d653f8a7a4a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } } }
I20260805 22:41:38.090672 9036 sys_catalog.cc:458] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:38.091673 9039 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:38.092342 9039 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:38.093191 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:38.092048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:45997 (local address 127.0.0.1:41129)
0805 22:41:38.092087 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:38.092089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:38.092098 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:38.092152 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:38.092154 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:38.092160 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:38.092195 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:38.092944 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:38.092946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:38.092946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:38.092951 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:38.092967 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:38.092972 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:38.093003 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:38.093111 (+ 108us) server_negotiation.cc:299] Negotiation successful
0805 22:41:38.093127 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:41:38.093834 9039 catalog_manager.cc:1347] Generated new cluster ID: e63a0f09aa324f38b29ef0ffff01aba4
I20260805 22:41:38.093888 9039 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:38.105952 9039 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:38.106185 9039 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:38.110308 9039 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d932b9fa299e4a7b9205d653f8a7a4a3: Generated new TSK 0
I20260805 22:41:38.110532 9039 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:38.116796 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 8959
2026-08-05T22:41:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1349 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:38 dist-test-slave-chsk krb5kdc[9062](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:38 dist-test-slave-chsk krb5kdc[9062](info): set up 2 sockets
Aug 05 22:41:38 dist-test-slave-chsk krb5kdc[9062](info): commencing operation
krb5kdc: starting...
W20260805 22:41:39.178771 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:39 dist-test-slave-chsk krb5kdc[9062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:39.318955 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41673
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:39.410213 9075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:39.410521 9075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:39.410569 9075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:39.412096 9075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:39.412187 9075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:39.412214 9075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:39.412236 9075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:39.412266 9075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:39.414008 9075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41673
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:39.414352 9075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:39.414625 9075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:39.420019 9080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:39.420161 9082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:39.420596 9084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:39.420629 9075 server_base.cc:1034] running on GCE node
I20260805 22:41:39.420953 9075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:39.421307 9075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:39.422490 9075 hybrid_clock.cc:648] HybridClock initialized: now 1785969699422465 us; error 53 us; skew 500 ppm
Aug 05 22:41:39 dist-test-slave-chsk krb5kdc[9062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969699, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:39.425416 9075 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:39.426339 9075 webserver.cc:460] Webserver started at http://127.0.0.1:32969/ using document root <none> and password file <none>
I20260805 22:41:39.426628 9075 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:39.426707 9075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:39.426882 9075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:39.428117 9075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "52a5523ea2884b87a8da7e0a1f8410c1"
format_stamp: "Formatted at 2026-08-05 22:41:39 on dist-test-slave-chsk"
server_key: "4ed17baf6b532f4274a37d1cdd667572"
server_key_iv: "9f69415eb7b26c8669d8cb58fd9d3cee"
server_key_version: "encryptionkey@0"
I20260805 22:41:39.428521 9075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "52a5523ea2884b87a8da7e0a1f8410c1"
format_stamp: "Formatted at 2026-08-05 22:41:39 on dist-test-slave-chsk"
server_key: "4ed17baf6b532f4274a37d1cdd667572"
server_key_iv: "9f69415eb7b26c8669d8cb58fd9d3cee"
server_key_version: "encryptionkey@0"
I20260805 22:41:39.430095 9075 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260805 22:41:39.430980 9092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:39.431234 9075 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:39.431347 9075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "52a5523ea2884b87a8da7e0a1f8410c1"
format_stamp: "Formatted at 2026-08-05 22:41:39 on dist-test-slave-chsk"
server_key: "4ed17baf6b532f4274a37d1cdd667572"
server_key_iv: "9f69415eb7b26c8669d8cb58fd9d3cee"
server_key_version: "encryptionkey@0"
I20260805 22:41:39.431445 9075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:39.444917 9075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:39.448293 9075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:39.448551 9075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:39.453351 9075 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41673
I20260805 22:41:39.453379 9146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41673 every 8 connection(s)
I20260805 22:41:39.453814 9075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:39.454806 9147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:39.456400 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 9075
I20260805 22:41:39.456565 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:39.456785 19766 external_mini_cluster.cc:1428] Setting key 64fb5185417905685e895736f74c5f58
I20260805 22:41:39.457978 9147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1: Bootstrap starting.
I20260805 22:41:39.458632 9147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:39.458948 9147 log.cc:824] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:39.459754 9147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1: No bootstrap required, opened a new log
I20260805 22:41:39.461689 9147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a5523ea2884b87a8da7e0a1f8410c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } }
I20260805 22:41:39.461875 9147 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:39.461930 9147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52a5523ea2884b87a8da7e0a1f8410c1, State: Initialized, Role: FOLLOWER
I20260805 22:41:39.462132 9147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a5523ea2884b87a8da7e0a1f8410c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } }
I20260805 22:41:39.462218 9147 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:39.462260 9147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:39.462317 9147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:39.463322 9147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a5523ea2884b87a8da7e0a1f8410c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } }
I20260805 22:41:39.463462 9147 leader_election.cc:302] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52a5523ea2884b87a8da7e0a1f8410c1; no voters:
I20260805 22:41:39.463680 9147 leader_election.cc:288] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:39.463752 9152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:39.463932 9152 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [term 1 LEADER]: Becoming Leader. State: Replica: 52a5523ea2884b87a8da7e0a1f8410c1, State: Running, Role: LEADER
I20260805 22:41:39.464004 9147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:39.464032 9152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a5523ea2884b87a8da7e0a1f8410c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } }
Aug 05 22:41:39 dist-test-slave-chsk krb5kdc[9062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:41:39.464413 9153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52a5523ea2884b87a8da7e0a1f8410c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a5523ea2884b87a8da7e0a1f8410c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } } }
I20260805 22:41:39.464517 9153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:39.464704 9154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52a5523ea2884b87a8da7e0a1f8410c1. Latest consensus state: current_term: 1 leader_uuid: "52a5523ea2884b87a8da7e0a1f8410c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a5523ea2884b87a8da7e0a1f8410c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } } }
I20260805 22:41:39.464771 9154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:39.464895 9158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:39.466572 9158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:39.468765 9158 catalog_manager.cc:1347] Generated new cluster ID: 8bcaf518a2004875a59e0bdbe892d9f5
I20260805 22:41:39.468838 9158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:39.469162 9150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:39.457423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:38773 (local address 127.0.0.1:41673)
0805 22:41:39.457665 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:39.457673 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:39.457707 (+ 34us) server_negotiation.cc:407] Connection header received
0805 22:41:39.458226 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:39.458235 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:39.458292 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:39.458449 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:39.459248 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:39.460249 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:39.461034 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:39.461471 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:39.461594 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:39.464938 (+ 3344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:39.464944 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:39.464944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:39.464959 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:39.467317 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:39.467815 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:39.467818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:39.467819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:39.467918 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:39.468202 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:39.468203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:39.468204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:39.468513 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:39.468702 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:39.468820 (+ 118us) server_negotiation.cc:299] Negotiation successful
0805 22:41:39.468929 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":117,"threads_started":1}
I20260805 22:41:39.470152 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:39.478694 9150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:39.471738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:42619 (local address 127.0.0.1:41673)
0805 22:41:39.471781 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:39.471783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:39.471793 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:39.471852 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:39.471853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:39.471863 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:39.471920 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:39.472511 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:39.473345 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:39.474097 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:39.474341 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:39.474423 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:39.475881 (+ 1458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:39.475883 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:39.475883 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:39.475892 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:39.477400 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:39.477820 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:39.477821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:39.477822 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:39.477888 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:39.478124 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:39.478126 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:39.478126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:39.478252 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:39.478369 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:39.478506 (+ 137us) server_negotiation.cc:299] Negotiation successful
0805 22:41:39.478574 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:41:39.493722 9158 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:39.494299 9158 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:39.502377 9158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52a5523ea2884b87a8da7e0a1f8410c1: Generated new TSK 0
I20260805 22:41:39.502604 9158 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:39.511370 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 9075
W20260805 22:41:39.517561 9060 connection.cc:535] client connection to 127.0.0.1:41673 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41673): Connection reset by peer (error 104)
2026-08-05T22:41:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1394 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:39 dist-test-slave-chsk krb5kdc[9178](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:39 dist-test-slave-chsk krb5kdc[9178](info): set up 2 sockets
Aug 05 22:41:39 dist-test-slave-chsk krb5kdc[9178](info): commencing operation
krb5kdc: starting...
W20260805 22:41:40.578982 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:40 dist-test-slave-chsk krb5kdc[9178](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:40.714002 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33797
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33797
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:40.800418 9192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:40.800721 9192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:40.800773 9192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:40.802088 9192 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:40.802181 9192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:40.802207 9192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:40.802229 9192 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:40.802260 9192 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:40.803978 9192 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33797
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:40.804312 9192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:40.804576 9192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:40.810065 9201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:40.810067 9199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:40.810248 9192 server_base.cc:1034] running on GCE node
W20260805 22:41:40.810067 9198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:40.810683 9192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:40.811019 9192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:40.812218 9192 hybrid_clock.cc:648] HybridClock initialized: now 1785969700812197 us; error 54 us; skew 500 ppm
Aug 05 22:41:40 dist-test-slave-chsk krb5kdc[9178](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969700, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:40.815187 9192 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:40.815915 9192 webserver.cc:460] Webserver started at http://127.0.0.1:42683/ using document root <none> and password file <none>
I20260805 22:41:40.816179 9192 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:40.816252 9192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:40.816406 9192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:40.817579 9192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "4360c382c1e9436c87e62317e3075cca"
format_stamp: "Formatted at 2026-08-05 22:41:40 on dist-test-slave-chsk"
server_key: "3a12e377c142068685bd29c1fb510a56"
server_key_iv: "0fe665a694a8fa6990be043b028d05b4"
server_key_version: "encryptionkey@0"
I20260805 22:41:40.818009 9192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "4360c382c1e9436c87e62317e3075cca"
format_stamp: "Formatted at 2026-08-05 22:41:40 on dist-test-slave-chsk"
server_key: "3a12e377c142068685bd29c1fb510a56"
server_key_iv: "0fe665a694a8fa6990be043b028d05b4"
server_key_version: "encryptionkey@0"
I20260805 22:41:40.819677 9192 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:40.820825 9208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:40.821161 9192 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:41:40.821360 9192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "4360c382c1e9436c87e62317e3075cca"
format_stamp: "Formatted at 2026-08-05 22:41:40 on dist-test-slave-chsk"
server_key: "3a12e377c142068685bd29c1fb510a56"
server_key_iv: "0fe665a694a8fa6990be043b028d05b4"
server_key_version: "encryptionkey@0"
I20260805 22:41:40.821491 9192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:40.834514 9192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:40.837169 9192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:40.837364 9192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:40.842294 9192 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33797
I20260805 22:41:40.842376 9260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33797 every 8 connection(s)
I20260805 22:41:40.842772 9192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:40.843799 9261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:40.846324 9261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca: Bootstrap starting.
I20260805 22:41:40.846956 9261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:40.847311 9261 log.cc:824] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:40.848156 9261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca: No bootstrap required, opened a new log
I20260805 22:41:40.849900 9261 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4360c382c1e9436c87e62317e3075cca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33797 } }
I20260805 22:41:40.850066 9261 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:40.850090 9261 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4360c382c1e9436c87e62317e3075cca, State: Initialized, Role: FOLLOWER
I20260805 22:41:40.850255 9261 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4360c382c1e9436c87e62317e3075cca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33797 } }
I20260805 22:41:40.850350 9261 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:40.850378 9261 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:40.850409 9261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:40.850647 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 9192
I20260805 22:41:40.850797 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:40.851015 19766 external_mini_cluster.cc:1428] Setting key 1038c95deb682cacaf9703ebd17b207c
I20260805 22:41:40.851446 9261 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4360c382c1e9436c87e62317e3075cca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33797 } }
I20260805 22:41:40.851632 9261 leader_election.cc:302] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4360c382c1e9436c87e62317e3075cca; no voters:
I20260805 22:41:40.851850 9261 leader_election.cc:288] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:40.851907 9266 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:40.852111 9266 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [term 1 LEADER]: Becoming Leader. State: Replica: 4360c382c1e9436c87e62317e3075cca, State: Running, Role: LEADER
I20260805 22:41:40.852134 9261 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:40.852213 9266 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4360c382c1e9436c87e62317e3075cca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33797 } }
I20260805 22:41:40.852648 9266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4360c382c1e9436c87e62317e3075cca. Latest consensus state: current_term: 1 leader_uuid: "4360c382c1e9436c87e62317e3075cca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4360c382c1e9436c87e62317e3075cca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33797 } } }
I20260805 22:41:40.852893 9266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:40.852805 9267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4360c382c1e9436c87e62317e3075cca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4360c382c1e9436c87e62317e3075cca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33797 } } }
I20260805 22:41:40.853354 9267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca [sys.catalog]: This master's current role is: LEADER
W20260805 22:41:40.854238 9283 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:41:40.854315 9283 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:41:40.854377 9276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:40.854545 9276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:40.856314 9276 catalog_manager.cc:1347] Generated new cluster ID: 6c45e10e5d2a46fd831fbf9eec767cbc
I20260805 22:41:40.856380 9276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:40.858068 9265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:40.851641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:49235 (local address 127.0.0.1:33797)
0805 22:41:40.851864 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:40.851876 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:40.851918 (+ 42us) server_negotiation.cc:407] Connection header received
0805 22:41:40.852065 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:40.852072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:40.852136 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:40.852576 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:40.852689 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:40.854594 (+ 1905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:40.855811 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:40.856397 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:40.856548 (+ 151us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:40.857359 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:40.857363 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:40.857364 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:40.857560 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:40.857594 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:40.857606 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:40.857702 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:40.857788 (+ 86us) server_negotiation.cc:299] Negotiation successful
0805 22:41:40.857819 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":119,"threads_started":1}
I20260805 22:41:40.859068 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:40.866585 9265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:40.860598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:52947 (local address 127.0.0.1:33797)
0805 22:41:40.860643 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:40.860645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:40.863503 (+ 2858us) server_negotiation.cc:407] Connection header received
0805 22:41:40.863592 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:40.863593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:40.863605 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:40.863665 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:40.863822 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:40.864353 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:40.865102 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:40.865330 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:40.865412 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:40.866260 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:40.866261 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:40.866261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:40.866267 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:40.866283 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:40.866288 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:40.866346 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:40.866423 (+ 77us) server_negotiation.cc:299] Negotiation successful
0805 22:41:40.866438 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:41:40.874648 9276 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:40.875339 9276 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:40.883834 9276 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4360c382c1e9436c87e62317e3075cca: Generated new TSK 0
I20260805 22:41:40.884120 9276 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:40.889956 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 9192
W20260805 22:41:40.896224 9176 connection.cc:535] client connection to 127.0.0.1:33797 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33797): Connection reset by peer (error 104)
2026-08-05T22:41:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1379 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:40 dist-test-slave-chsk krb5kdc[9295](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:40 dist-test-slave-chsk krb5kdc[9295](info): set up 2 sockets
Aug 05 22:41:40 dist-test-slave-chsk krb5kdc[9295](info): commencing operation
krb5kdc: starting...
W20260805 22:41:41.959389 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:42 dist-test-slave-chsk krb5kdc[9295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:41:42.094614 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46573
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:42.180466 9308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:42.180759 9308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:42.180807 9308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:42.182129 9308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:42.182214 9308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:42.182238 9308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:42.182260 9308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:42.182291 9308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:42.183956 9308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46573
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:42.184284 9308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:42.184549 9308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:42.189885 9313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:42.189880 9314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:42.189916 9316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:42.190241 9308 server_base.cc:1034] running on GCE node
I20260805 22:41:42.190492 9308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:42.190840 9308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:42.192025 9308 hybrid_clock.cc:648] HybridClock initialized: now 1785969702191996 us; error 54 us; skew 500 ppm
Aug 05 22:41:42 dist-test-slave-chsk krb5kdc[9295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969702, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:42.194729 9308 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:41:42.195267 9308 webserver.cc:460] Webserver started at http://127.0.0.1:34791/ using document root <none> and password file <none>
I20260805 22:41:42.195473 9308 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:42.195516 9308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:42.195616 9308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:42.196702 9308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "765bad7a0a194d6fb30bce628a13ca18"
format_stamp: "Formatted at 2026-08-05 22:41:42 on dist-test-slave-chsk"
server_key: "f87d3d00843598c6e40386114d957510"
server_key_iv: "cf19a1f76052071530e082dabcd62b83"
server_key_version: "encryptionkey@0"
I20260805 22:41:42.197026 9308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "765bad7a0a194d6fb30bce628a13ca18"
format_stamp: "Formatted at 2026-08-05 22:41:42 on dist-test-slave-chsk"
server_key: "f87d3d00843598c6e40386114d957510"
server_key_iv: "cf19a1f76052071530e082dabcd62b83"
server_key_version: "encryptionkey@0"
I20260805 22:41:42.198508 9308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:42.199726 9324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:42.200089 9308 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:42.200204 9308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "765bad7a0a194d6fb30bce628a13ca18"
format_stamp: "Formatted at 2026-08-05 22:41:42 on dist-test-slave-chsk"
server_key: "f87d3d00843598c6e40386114d957510"
server_key_iv: "cf19a1f76052071530e082dabcd62b83"
server_key_version: "encryptionkey@0"
I20260805 22:41:42.200284 9308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:42.204176 9308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:42.206916 9308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:42.207056 9308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:42.211874 9308 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46573
I20260805 22:41:42.211930 9379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46573 every 8 connection(s)
I20260805 22:41:42.212306 9308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:42.213397 9380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:42.216042 9380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18: Bootstrap starting.
I20260805 22:41:42.216713 9380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:42.217036 9380 log.cc:824] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:42.217865 9380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18: No bootstrap required, opened a new log
I20260805 22:41:42.220010 9380 raft_consensus.cc:348] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765bad7a0a194d6fb30bce628a13ca18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46573 } }
I20260805 22:41:42.220218 9380 raft_consensus.cc:374] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:42.220273 9380 raft_consensus.cc:729] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765bad7a0a194d6fb30bce628a13ca18, State: Initialized, Role: FOLLOWER
I20260805 22:41:42.220475 9380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765bad7a0a194d6fb30bce628a13ca18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46573 } }
I20260805 22:41:42.220584 9380 raft_consensus.cc:388] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:42.220635 9380 raft_consensus.cc:482] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:42.220691 9380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:42.220903 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 9308
I20260805 22:41:42.221040 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:42.221284 19766 external_mini_cluster.cc:1428] Setting key d257172aae1fb2ecce29ac3b67bf5f3a
I20260805 22:41:42.221489 9380 raft_consensus.cc:504] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765bad7a0a194d6fb30bce628a13ca18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46573 } }
I20260805 22:41:42.221616 9380 leader_election.cc:302] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 765bad7a0a194d6fb30bce628a13ca18; no voters:
I20260805 22:41:42.221837 9380 leader_election.cc:288] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:42.221896 9383 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:42.222141 9383 raft_consensus.cc:686] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [term 1 LEADER]: Becoming Leader. State: Replica: 765bad7a0a194d6fb30bce628a13ca18, State: Running, Role: LEADER
I20260805 22:41:42.222222 9380 sys_catalog.cc:564] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:42.222255 9383 consensus_queue.cc:237] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765bad7a0a194d6fb30bce628a13ca18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46573 } }
I20260805 22:41:42.222818 9386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "765bad7a0a194d6fb30bce628a13ca18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765bad7a0a194d6fb30bce628a13ca18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46573 } } }
I20260805 22:41:42.223045 9386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:42.222975 9387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 765bad7a0a194d6fb30bce628a13ca18. Latest consensus state: current_term: 1 leader_uuid: "765bad7a0a194d6fb30bce628a13ca18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765bad7a0a194d6fb30bce628a13ca18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46573 } } }
I20260805 22:41:42.223376 9387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18 [sys.catalog]: This master's current role is: LEADER
W20260805 22:41:42.224323 9401 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:41:42.224390 9401 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:41:42.224460 9394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:42.224656 9394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:42.224673 9385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:42.221848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:48487 (local address 127.0.0.1:46573)
0805 22:41:42.222722 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:42.222733 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:42.222773 (+ 40us) server_negotiation.cc:407] Connection header received
0805 22:41:42.222909 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:42.222917 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:42.222951 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:42.223510 (+ 559us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:42.224149 (+ 639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:42.224153 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:42.224153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:42.224158 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:42.224199 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:42.224214 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:42.224287 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:42.224416 (+ 129us) server_negotiation.cc:299] Negotiation successful
0805 22:41:42.224470 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":95,"threads_started":1}
I20260805 22:41:42.225766 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:42.226439 9394 catalog_manager.cc:1347] Generated new cluster ID: a1b79aa9176b4e89801e2fb6c657ab88
I20260805 22:41:42.226495 9394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:42.228711 9385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:42.227497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:36487 (local address 127.0.0.1:46573)
0805 22:41:42.227537 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:42.227539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:42.227661 (+ 122us) server_negotiation.cc:407] Connection header received
0805 22:41:42.227729 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:42.227730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:42.227736 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:42.227793 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:42.228462 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:42.228463 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:42.228463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:42.228467 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:42.228484 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:42.228489 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:42.228546 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:42.228618 (+ 72us) server_negotiation.cc:299] Negotiation successful
0805 22:41:42.228639 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:41:42.247535 9394 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:42.247756 9394 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:42.252671 9394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 765bad7a0a194d6fb30bce628a13ca18: Generated new TSK 0
I20260805 22:41:42.252938 9394 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:42.263043 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 9308
2026-08-05T22:41:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1373 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:42 dist-test-slave-chsk krb5kdc[9412](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:42 dist-test-slave-chsk krb5kdc[9412](info): set up 2 sockets
Aug 05 22:41:42 dist-test-slave-chsk krb5kdc[9412](info): commencing operation
krb5kdc: starting...
W20260805 22:41:43.335170 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:43 dist-test-slave-chsk krb5kdc[9412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:43.471915 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:38849
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:32787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:38849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:43.557551 9425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:43.557780 9425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:43.557806 9425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:43.559056 9425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:43.559118 9425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:43.559134 9425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:43.559216 9425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:43.559243 9425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:43.560876 9425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:32787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:38849
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:38849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:43.561167 9425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:43.561434 9425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:43.566557 9434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:43.566557 9431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:43.566560 9432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:43.566838 9425 server_base.cc:1034] running on GCE node
I20260805 22:41:43.567092 9425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:43.567447 9425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:43.568634 9425 hybrid_clock.cc:648] HybridClock initialized: now 1785969703568623 us; error 34 us; skew 500 ppm
Aug 05 22:41:43 dist-test-slave-chsk krb5kdc[9412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969703, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:43.575577 9425 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:43.576184 9425 webserver.cc:460] Webserver started at http://127.19.77.190:45271/ using document root <none> and password file <none>
I20260805 22:41:43.576470 9425 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:43.576550 9425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:43.576718 9425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:43.577957 9425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "a40e83092d5448b6b3637666041a25e3"
format_stamp: "Formatted at 2026-08-05 22:41:43 on dist-test-slave-chsk"
server_key: "efbafe89f3dce6640a1809bb4864d0a1"
server_key_iv: "6596474d82483d97e2b2ee5b2d215257"
server_key_version: "encryptionkey@0"
I20260805 22:41:43.578342 9425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "a40e83092d5448b6b3637666041a25e3"
format_stamp: "Formatted at 2026-08-05 22:41:43 on dist-test-slave-chsk"
server_key: "efbafe89f3dce6640a1809bb4864d0a1"
server_key_iv: "6596474d82483d97e2b2ee5b2d215257"
server_key_version: "encryptionkey@0"
I20260805 22:41:43.580010 9425 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:43.580840 9441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:43.581065 9425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:43.581187 9425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "a40e83092d5448b6b3637666041a25e3"
format_stamp: "Formatted at 2026-08-05 22:41:43 on dist-test-slave-chsk"
server_key: "efbafe89f3dce6640a1809bb4864d0a1"
server_key_iv: "6596474d82483d97e2b2ee5b2d215257"
server_key_version: "encryptionkey@0"
I20260805 22:41:43.581274 9425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:43.596580 9425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:43.598743 9425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:43.598928 9425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:43.603283 9425 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:38849
I20260805 22:41:43.603335 9494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:38849 every 8 connection(s)
I20260805 22:41:43.603740 9425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:43.604630 9495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:43.607002 9495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3: Bootstrap starting.
I20260805 22:41:43.607681 9495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:43.607982 9495 log.cc:824] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:43.608253 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 9425
I20260805 22:41:43.608394 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:43.608603 19766 external_mini_cluster.cc:1428] Setting key c590d4a3d9f6cc4e20322391624efa8b
I20260805 22:41:43.608824 9495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3: No bootstrap required, opened a new log
I20260805 22:41:43.611191 9495 raft_consensus.cc:348] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a40e83092d5448b6b3637666041a25e3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38849 } }
I20260805 22:41:43.611392 9495 raft_consensus.cc:374] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:43.611428 9495 raft_consensus.cc:729] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a40e83092d5448b6b3637666041a25e3, State: Initialized, Role: FOLLOWER
I20260805 22:41:43.611588 9495 consensus_queue.cc:260] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a40e83092d5448b6b3637666041a25e3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38849 } }
I20260805 22:41:43.611693 9495 raft_consensus.cc:388] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:43.611726 9495 raft_consensus.cc:482] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:43.611775 9495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:43.612588 9495 raft_consensus.cc:504] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a40e83092d5448b6b3637666041a25e3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38849 } }
I20260805 22:41:43.612718 9495 leader_election.cc:302] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a40e83092d5448b6b3637666041a25e3; no voters:
I20260805 22:41:43.612883 9495 leader_election.cc:288] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:43.612967 9500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:43.613169 9495 sys_catalog.cc:564] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:43.613178 9500 raft_consensus.cc:686] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [term 1 LEADER]: Becoming Leader. State: Replica: a40e83092d5448b6b3637666041a25e3, State: Running, Role: LEADER
I20260805 22:41:43.613308 9500 consensus_queue.cc:237] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a40e83092d5448b6b3637666041a25e3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38849 } }
I20260805 22:41:43.613701 9501 sys_catalog.cc:455] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a40e83092d5448b6b3637666041a25e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a40e83092d5448b6b3637666041a25e3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38849 } } }
I20260805 22:41:43.613790 9501 sys_catalog.cc:458] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:43.613754 9502 sys_catalog.cc:455] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a40e83092d5448b6b3637666041a25e3. Latest consensus state: current_term: 1 leader_uuid: "a40e83092d5448b6b3637666041a25e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a40e83092d5448b6b3637666041a25e3" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 38849 } } }
I20260805 22:41:43.613849 9502 sys_catalog.cc:458] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:43.614770 9508 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:43.615576 9508 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:43.617493 9508 catalog_manager.cc:1347] Generated new cluster ID: ab11eed7a98445e48a93591c936ed1d5
I20260805 22:41:43.617549 9508 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 05 22:41:43 dist-test-slave-chsk krb5kdc[9412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:43.622642 9499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:43.609209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44317 (local address 127.19.77.190:38849)
0805 22:41:43.609416 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:43.609426 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:43.609464 (+ 38us) server_negotiation.cc:407] Connection header received
0805 22:41:43.610321 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:43.610331 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:43.610400 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:43.610570 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:43.611234 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:43.612932 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:43.614427 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:43.615086 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:43.615261 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:43.618174 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:43.618179 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:43.618180 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:43.618193 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:43.620530 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:43.621063 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:43.621067 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:43.621068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:43.621192 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:43.621440 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:43.621441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:43.621441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:43.621803 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:43.622004 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:43.622115 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 22:41:43.622227 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":95,"threads_started":1}
I20260805 22:41:43.623804 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:43.626636 9508 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:43.627413 9508 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:43.632400 9499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:43.625553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60913 (local address 127.19.77.190:38849)
0805 22:41:43.625588 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:43.625590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:43.625599 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:43.625659 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:43.625660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:43.625669 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:43.625722 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:43.626593 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:43.627126 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:43.628029 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:43.628268 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:43.628352 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:43.629647 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:43.629648 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:43.629648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:43.629656 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:43.631121 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:43.631564 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:43.631565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:43.631565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:43.631628 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:43.631853 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:43.631854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:43.631855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:43.631979 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:43.632091 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:43.632216 (+ 125us) server_negotiation.cc:299] Negotiation successful
0805 22:41:43.632282 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260805 22:41:43.636364 9508 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a40e83092d5448b6b3637666041a25e3: Generated new TSK 0
I20260805 22:41:43.636596 9508 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:43.640455 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 9425
W20260805 22:41:43.646193 9409 connection.cc:535] client connection to 127.19.77.190:38849 recv error: Network error: failed to read from TLS socket (remote: 127.19.77.190:38849): Connection reset by peer (error 104)
2026-08-05T22:41:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1376 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:43 dist-test-slave-chsk krb5kdc[9526](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:43 dist-test-slave-chsk krb5kdc[9526](info): set up 2 sockets
Aug 05 22:41:43 dist-test-slave-chsk krb5kdc[9526](info): commencing operation
krb5kdc: starting...
W20260805 22:41:44.702860 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:44 dist-test-slave-chsk krb5kdc[9526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:44.838255 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:46425
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:44305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:46425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:44.923059 9539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:44.923388 9539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:44.923435 9539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:44.924749 9539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:44.924842 9539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:44.924867 9539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:44.924890 9539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:44.924921 9539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:44.926569 9539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:44305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:46425
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:46425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:44.926898 9539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:44.927182 9539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:44.932585 9544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:44.932585 9550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:44.932585 9548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:44.932862 9539 server_base.cc:1034] running on GCE node
I20260805 22:41:44.933120 9539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:44.933403 9539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:44.934559 9539 hybrid_clock.cc:648] HybridClock initialized: now 1785969704934537 us; error 44 us; skew 500 ppm
Aug 05 22:41:44 dist-test-slave-chsk krb5kdc[9526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969704, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:44.937196 9539 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:44.937634 9539 webserver.cc:460] Webserver started at http://127.19.77.190:38889/ using document root <none> and password file <none>
I20260805 22:41:44.937829 9539 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:44.937870 9539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:44.937968 9539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:44.939050 9539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "4cf3b38f9a0142e88965156a83464dde"
format_stamp: "Formatted at 2026-08-05 22:41:44 on dist-test-slave-chsk"
server_key: "d576790bd80f2e5759e26d41760451d7"
server_key_iv: "37e59a06367189bf43f8bedc27bd97a9"
server_key_version: "encryptionkey@0"
I20260805 22:41:44.939456 9539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "4cf3b38f9a0142e88965156a83464dde"
format_stamp: "Formatted at 2026-08-05 22:41:44 on dist-test-slave-chsk"
server_key: "d576790bd80f2e5759e26d41760451d7"
server_key_iv: "37e59a06367189bf43f8bedc27bd97a9"
server_key_version: "encryptionkey@0"
I20260805 22:41:44.940928 9539 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:44.941731 9557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:44.941958 9539 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:44.942097 9539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "4cf3b38f9a0142e88965156a83464dde"
format_stamp: "Formatted at 2026-08-05 22:41:44 on dist-test-slave-chsk"
server_key: "d576790bd80f2e5759e26d41760451d7"
server_key_iv: "37e59a06367189bf43f8bedc27bd97a9"
server_key_version: "encryptionkey@0"
I20260805 22:41:44.942189 9539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:44.955981 9539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:44.958191 9539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:44.958397 9539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:44.963073 9539 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:46425
I20260805 22:41:44.963114 9611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:46425 every 8 connection(s)
I20260805 22:41:44.963589 9539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:44.964445 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 9539
I20260805 22:41:44.964589 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:44.964617 9612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:44.964839 19766 external_mini_cluster.cc:1428] Setting key ff5c5321f225047d73c8476b5c2e7bfd
I20260805 22:41:44.967849 9612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde: Bootstrap starting.
I20260805 22:41:44.968514 9612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:44.968842 9612 log.cc:824] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:44.969684 9612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde: No bootstrap required, opened a new log
I20260805 22:41:44.970715 9615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:44.965556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53413 (local address 127.19.77.190:46425)
0805 22:41:44.965775 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:44.965785 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:44.965821 (+ 36us) server_negotiation.cc:407] Connection header received
0805 22:41:44.966263 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:44.966270 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:44.966328 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:44.966494 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:44.966732 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:44.967739 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:44.968592 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:44.969087 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:44.969214 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:44.970085 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:44.970089 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:44.970090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:44.970264 (+ 174us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:44.970297 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:44.970309 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:44.970408 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:44.970491 (+ 83us) server_negotiation.cc:299] Negotiation successful
0805 22:41:44.970530 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":86,"threads_started":1}
I20260805 22:41:44.971839 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:44.972229 9612 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf3b38f9a0142e88965156a83464dde" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46425 } }
I20260805 22:41:44.972384 9612 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:44.972409 9612 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf3b38f9a0142e88965156a83464dde, State: Initialized, Role: FOLLOWER
I20260805 22:41:44.972561 9612 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf3b38f9a0142e88965156a83464dde" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46425 } }
I20260805 22:41:44.972636 9612 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:44.972687 9612 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:44.972738 9612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:44.973649 9612 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf3b38f9a0142e88965156a83464dde" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46425 } }
I20260805 22:41:44.973793 9612 leader_election.cc:302] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cf3b38f9a0142e88965156a83464dde; no voters:
I20260805 22:41:44.974026 9612 leader_election.cc:288] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:44.974067 9622 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:44.974198 9622 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [term 1 LEADER]: Becoming Leader. State: Replica: 4cf3b38f9a0142e88965156a83464dde, State: Running, Role: LEADER
I20260805 22:41:44.974305 9612 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:44.974284 9622 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf3b38f9a0142e88965156a83464dde" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46425 } }
I20260805 22:41:44.974644 9622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cf3b38f9a0142e88965156a83464dde. Latest consensus state: current_term: 1 leader_uuid: "4cf3b38f9a0142e88965156a83464dde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf3b38f9a0142e88965156a83464dde" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46425 } } }
I20260805 22:41:44.974735 9622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:44.974658 9623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4cf3b38f9a0142e88965156a83464dde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf3b38f9a0142e88965156a83464dde" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46425 } } }
I20260805 22:41:44.974905 9623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:44.974974 9629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:44.975589 9629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:44.977172 9615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:44.973426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36257 (local address 127.19.77.190:46425)
0805 22:41:44.973469 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:44.973471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:44.973534 (+ 63us) server_negotiation.cc:407] Connection header received
0805 22:41:44.973603 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:44.973604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:44.973614 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:44.973672 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:44.973821 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:44.974555 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:44.975658 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:44.976084 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:44.976181 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:44.976939 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:44.976940 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:44.976941 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:44.976946 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:44.976961 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:44.976965 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:44.977017 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:44.977077 (+ 60us) server_negotiation.cc:299] Negotiation successful
0805 22:41:44.977087 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:41:44.977648 9629 catalog_manager.cc:1347] Generated new cluster ID: c5930c26d294479e8ec61bd79a1f2a21
I20260805 22:41:44.977705 9629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:44.982825 9629 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:44.983492 9629 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:44.990644 9629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4cf3b38f9a0142e88965156a83464dde: Generated new TSK 0
I20260805 22:41:44.990881 9629 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:45.001169 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 9539
W20260805 22:41:45.007825 9524 connection.cc:535] client connection to 127.19.77.190:46425 recv error: Network error: failed to read from TLS socket (remote: 127.19.77.190:46425): Connection reset by peer (error 104)
2026-08-05T22:41:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1361 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:45 dist-test-slave-chsk krb5kdc[9644](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:45 dist-test-slave-chsk krb5kdc[9644](info): set up 2 sockets
Aug 05 22:41:45 dist-test-slave-chsk krb5kdc[9644](info): commencing operation
krb5kdc: starting...
W20260805 22:41:46.052855 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:46 dist-test-slave-chsk krb5kdc[9644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:46.198807 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43221
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:43221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:46.290577 9657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:46.290895 9657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:46.290938 9657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:46.292280 9657 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:46.292372 9657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:46.292397 9657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:46.292420 9657 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:46.292482 9657 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:46.294175 9657 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:43221
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:43221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:46.294515 9657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:46.294778 9657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:46.301017 9663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:46.301065 9662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:46.301182 9657 server_base.cc:1034] running on GCE node
W20260805 22:41:46.301043 9665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:46.301649 9657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:46.302038 9657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:46.303314 9657 hybrid_clock.cc:648] HybridClock initialized: now 1785969706303338 us; error 97 us; skew 500 ppm
Aug 05 22:41:46 dist-test-slave-chsk krb5kdc[9644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969706, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:46.306447 9657 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:46.306959 9657 webserver.cc:460] Webserver started at http://127.19.77.190:33621/ using document root <none> and password file <none>
I20260805 22:41:46.307297 9657 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:46.307374 9657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:46.307550 9657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:46.308704 9657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649"
format_stamp: "Formatted at 2026-08-05 22:41:46 on dist-test-slave-chsk"
server_key: "a226f94ddebf8008b1b2cd8abb84692c"
server_key_iv: "919dc089cc6f12739e827b3789cdf4be"
server_key_version: "encryptionkey@0"
I20260805 22:41:46.309106 9657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649"
format_stamp: "Formatted at 2026-08-05 22:41:46 on dist-test-slave-chsk"
server_key: "a226f94ddebf8008b1b2cd8abb84692c"
server_key_iv: "919dc089cc6f12739e827b3789cdf4be"
server_key_version: "encryptionkey@0"
I20260805 22:41:46.310654 9657 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:46.311833 9672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:46.312141 9657 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260805 22:41:46.312407 9657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649"
format_stamp: "Formatted at 2026-08-05 22:41:46 on dist-test-slave-chsk"
server_key: "a226f94ddebf8008b1b2cd8abb84692c"
server_key_iv: "919dc089cc6f12739e827b3789cdf4be"
server_key_version: "encryptionkey@0"
I20260805 22:41:46.312536 9657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:46.316387 9657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:46.319423 9657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:46.319644 9657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:46.325589 9657 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:43221
I20260805 22:41:46.325659 9726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:43221 every 8 connection(s)
I20260805 22:41:46.326043 9657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:46.327538 9727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:46.330936 9727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649: Bootstrap starting.
I20260805 22:41:46.331849 9727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:46.332134 9727 log.cc:824] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:46.333122 9727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649: No bootstrap required, opened a new log
I20260805 22:41:46.335052 9727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43221 } }
I20260805 22:41:46.335315 9727 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:46.335345 9727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fb2ca60ea0b42ebb84b6ec42bdd1649, State: Initialized, Role: FOLLOWER
I20260805 22:41:46.335501 9727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43221 } }
I20260805 22:41:46.335590 9727 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:46.335649 9727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:46.335702 9727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:46.335769 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 9657
I20260805 22:41:46.335916 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:46.336364 19766 external_mini_cluster.cc:1428] Setting key 880cd367f495aa229b98e7a091ae4306
I20260805 22:41:46.336946 9727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43221 } }
I20260805 22:41:46.337106 9727 leader_election.cc:302] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fb2ca60ea0b42ebb84b6ec42bdd1649; no voters:
I20260805 22:41:46.337313 9727 leader_election.cc:288] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:46.337513 9731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:46.337724 9727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:46.337814 9731 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [term 1 LEADER]: Becoming Leader. State: Replica: 3fb2ca60ea0b42ebb84b6ec42bdd1649, State: Running, Role: LEADER
I20260805 22:41:46.337976 9731 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43221 } }
I20260805 22:41:46.338500 9731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fb2ca60ea0b42ebb84b6ec42bdd1649. Latest consensus state: current_term: 1 leader_uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43221 } } }
I20260805 22:41:46.338591 9731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:46.338847 9741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:46.339495 9741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:46.339689 9732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:46.337253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50029 (local address 127.19.77.190:43221)
0805 22:41:46.337565 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:46.337577 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:46.337643 (+ 66us) server_negotiation.cc:407] Connection header received
0805 22:41:46.337802 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:46.337810 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:46.337880 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:46.338096 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:46.338927 (+ 831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:46.338932 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:46.338932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:46.338939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:46.339002 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:46.339020 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:46.339101 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:46.339403 (+ 302us) server_negotiation.cc:299] Negotiation successful
0805 22:41:46.339460 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":80,"threads_started":1}
I20260805 22:41:46.339875 9734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb2ca60ea0b42ebb84b6ec42bdd1649" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 43221 } } }
I20260805 22:41:46.340224 9734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:46.341431 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:46.341898 9741 catalog_manager.cc:1347] Generated new cluster ID: c4fb3bdcb39841ae814be914907118b0
I20260805 22:41:46.341979 9741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:46.349079 9732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:46.343132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58043 (local address 127.19.77.190:43221)
0805 22:41:46.343193 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:46.343195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:46.347597 (+ 4402us) server_negotiation.cc:407] Connection header received
0805 22:41:46.347724 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:46.347725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:46.347735 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:46.347803 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:46.348805 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:46.348807 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:46.348808 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:46.348813 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:46.348833 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:46.348838 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:46.348909 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:46.348980 (+ 71us) server_negotiation.cc:299] Negotiation successful
0805 22:41:46.348996 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:41:46.350153 9741 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:46.350323 9741 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:46.359541 9741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3fb2ca60ea0b42ebb84b6ec42bdd1649: Generated new TSK 0
I20260805 22:41:46.359805 9741 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:46.366683 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 9657
2026-08-05T22:41:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1364 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:46 dist-test-slave-chsk krb5kdc[9758](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:46 dist-test-slave-chsk krb5kdc[9758](info): set up 2 sockets
Aug 05 22:41:46 dist-test-slave-chsk krb5kdc[9758](info): commencing operation
krb5kdc: starting...
W20260805 22:41:47.447391 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:47 dist-test-slave-chsk krb5kdc[9758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:47.578352 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34535
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:42383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:34535
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:47.663995 9772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:47.664232 9772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:47.664297 9772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:47.665591 9772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:47.665654 9772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:47.665669 9772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:47.665683 9772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:47.665695 9772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:47.667336 9772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:42383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:34535
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:34535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:47.667563 9772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:47.667768 9772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:47.673022 9777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:47.673013 9780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:47.673013 9778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:47.673151 9772 server_base.cc:1034] running on GCE node
I20260805 22:41:47.673605 9772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:47.674000 9772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:47.675215 9772 hybrid_clock.cc:648] HybridClock initialized: now 1785969707675197 us; error 48 us; skew 500 ppm
Aug 05 22:41:47 dist-test-slave-chsk krb5kdc[9758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969707, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:47.677920 9772 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:47.678440 9772 webserver.cc:460] Webserver started at http://127.19.77.190:44283/ using document root <none> and password file <none>
I20260805 22:41:47.678727 9772 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:47.678807 9772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:47.678974 9772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:47.680209 9772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "20aa458d960c4d468e3b1c9475543f13"
format_stamp: "Formatted at 2026-08-05 22:41:47 on dist-test-slave-chsk"
server_key: "35157135f9c90808b51adf94a93556bc"
server_key_iv: "079f5e1bfd1a6a77e5cfd723d449b3a0"
server_key_version: "encryptionkey@0"
I20260805 22:41:47.680616 9772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "20aa458d960c4d468e3b1c9475543f13"
format_stamp: "Formatted at 2026-08-05 22:41:47 on dist-test-slave-chsk"
server_key: "35157135f9c90808b51adf94a93556bc"
server_key_iv: "079f5e1bfd1a6a77e5cfd723d449b3a0"
server_key_version: "encryptionkey@0"
I20260805 22:41:47.682188 9772 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:47.682988 9788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:47.683228 9772 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:47.683334 9772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "20aa458d960c4d468e3b1c9475543f13"
format_stamp: "Formatted at 2026-08-05 22:41:47 on dist-test-slave-chsk"
server_key: "35157135f9c90808b51adf94a93556bc"
server_key_iv: "079f5e1bfd1a6a77e5cfd723d449b3a0"
server_key_version: "encryptionkey@0"
I20260805 22:41:47.683427 9772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:47.695429 9772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:47.697531 9772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:47.697731 9772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:47.702353 9772 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:34535
I20260805 22:41:47.702390 9842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:34535 every 8 connection(s)
I20260805 22:41:47.702781 9772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:47.703796 9843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:47.704491 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 9772
I20260805 22:41:47.704598 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:47.704826 19766 external_mini_cluster.cc:1428] Setting key 1f3f5b1fd3e322229f30f5be831f7c96
I20260805 22:41:47.707309 9843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13: Bootstrap starting.
I20260805 22:41:47.707978 9843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:47.708295 9843 log.cc:824] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:47.709131 9843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13: No bootstrap required, opened a new log
I20260805 22:41:47.711925 9843 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa458d960c4d468e3b1c9475543f13" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34535 } }
I20260805 22:41:47.712122 9843 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:47.712149 9843 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20aa458d960c4d468e3b1c9475543f13, State: Initialized, Role: FOLLOWER
I20260805 22:41:47.712296 9843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa458d960c4d468e3b1c9475543f13" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34535 } }
I20260805 22:41:47.712366 9843 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:47.712389 9843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:47.712460 9843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [term 0 FOLLOWER]: Advancing to term 1
Aug 05 22:41:47 dist-test-slave-chsk krb5kdc[9758](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:47.713245 9843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa458d960c4d468e3b1c9475543f13" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34535 } }
I20260805 22:41:47.713397 9843 leader_election.cc:302] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20aa458d960c4d468e3b1c9475543f13; no voters:
I20260805 22:41:47.713589 9843 leader_election.cc:288] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:47.713663 9849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:47.713860 9849 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [term 1 LEADER]: Becoming Leader. State: Replica: 20aa458d960c4d468e3b1c9475543f13, State: Running, Role: LEADER
I20260805 22:41:47.713922 9843 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:47.713989 9849 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa458d960c4d468e3b1c9475543f13" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34535 } }
I20260805 22:41:47.714382 9849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20aa458d960c4d468e3b1c9475543f13. Latest consensus state: current_term: 1 leader_uuid: "20aa458d960c4d468e3b1c9475543f13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa458d960c4d468e3b1c9475543f13" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34535 } } }
I20260805 22:41:47.714501 9850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20aa458d960c4d468e3b1c9475543f13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa458d960c4d468e3b1c9475543f13" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 34535 } } }
I20260805 22:41:47.714534 9849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:47.714610 9850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:47.714838 9858 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:47.715492 9858 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:47.717144 9867 mvcc.cc:205] Tried to move back new op lower bound from 7315331922807341056 to 7315331922796941312. Current Snapshot: MvccSnapshot[applied={T|T < 7315331922807341056}]
I20260805 22:41:47.717671 9858 catalog_manager.cc:1347] Generated new cluster ID: 620619547f984370ba5eb9b948f5feaa
I20260805 22:41:47.717681 9846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:47.705549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45639 (local address 127.19.77.190:34535)
0805 22:41:47.705746 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:47.705754 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:47.705781 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:41:47.706258 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:47.706264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:47.706314 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:47.706432 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:47.707311 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:47.708337 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:47.709486 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:47.709948 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:47.710043 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:47.713202 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:47.713207 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:47.713208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:47.713223 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:47.715648 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:47.716150 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:47.716153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:47.716153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:47.716267 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:47.716496 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:47.716497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:47.716497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:47.716855 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:47.717008 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:47.717280 (+ 272us) server_negotiation.cc:299] Negotiation successful
0805 22:41:47.717442 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":99,"threads_started":1}
I20260805 22:41:47.717732 9858 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:47.718734 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:47.731381 9846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:47.720339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60059 (local address 127.19.77.190:34535)
0805 22:41:47.720381 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:47.720384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:47.723456 (+ 3072us) server_negotiation.cc:407] Connection header received
0805 22:41:47.723542 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:47.723544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:47.723556 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:47.723607 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:47.724251 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:47.724787 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:47.725735 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:47.726094 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:47.726145 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:47.727976 (+ 1831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:47.727978 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:47.727978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:47.727987 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:47.729781 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:47.730298 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:47.730299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:47.730300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:47.730364 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:47.730585 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:47.730586 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:47.730586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:47.730743 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:47.730821 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:47.731076 (+ 255us) server_negotiation.cc:299] Negotiation successful
0805 22:41:47.731236 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:41:47.738889 9858 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:47.739881 9858 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:47.745182 9858 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20aa458d960c4d468e3b1c9475543f13: Generated new TSK 0
I20260805 22:41:47.745436 9858 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:47.747782 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 9772
2026-08-05T22:41:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1381 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:47 dist-test-slave-chsk krb5kdc[9876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:47 dist-test-slave-chsk krb5kdc[9876](info): set up 2 sockets
Aug 05 22:41:47 dist-test-slave-chsk krb5kdc[9876](info): commencing operation
krb5kdc: starting...
W20260805 22:41:48.814924 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:48 dist-test-slave-chsk krb5kdc[9876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:48.950563 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:46727
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:33109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:46727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:49.039381 9890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:49.039669 9890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:49.039716 9890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:49.041226 9890 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:49.041320 9890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:49.041344 9890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:49.041366 9890 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:49.041401 9890 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:49.043226 9890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:33109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:46727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:46727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:49.043561 9890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:49.043830 9890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:49.049276 9898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:49.049439 9890 server_base.cc:1034] running on GCE node
W20260805 22:41:49.049302 9896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:49.049301 9895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:49.049921 9890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:49.050288 9890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:49.051472 9890 hybrid_clock.cc:648] HybridClock initialized: now 1785969709051458 us; error 53 us; skew 500 ppm
Aug 05 22:41:49 dist-test-slave-chsk krb5kdc[9876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:49.057847 9890 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:49.058423 9890 webserver.cc:460] Webserver started at http://127.19.77.190:46813/ using document root <none> and password file <none>
I20260805 22:41:49.058672 9890 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:49.058722 9890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:49.058830 9890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:49.060491 9890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "2ade8c809f674142b282109d98768ac4"
format_stamp: "Formatted at 2026-08-05 22:41:49 on dist-test-slave-chsk"
server_key: "4b58e0fc90a55ec182e14efcb2b9983d"
server_key_iv: "9f5704df4681c6b9d660b5cbf1bad959"
server_key_version: "encryptionkey@0"
I20260805 22:41:49.061023 9890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "2ade8c809f674142b282109d98768ac4"
format_stamp: "Formatted at 2026-08-05 22:41:49 on dist-test-slave-chsk"
server_key: "4b58e0fc90a55ec182e14efcb2b9983d"
server_key_iv: "9f5704df4681c6b9d660b5cbf1bad959"
server_key_version: "encryptionkey@0"
I20260805 22:41:49.063475 9890 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260805 22:41:49.064631 9906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:49.064929 9890 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:49.065081 9890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "2ade8c809f674142b282109d98768ac4"
format_stamp: "Formatted at 2026-08-05 22:41:49 on dist-test-slave-chsk"
server_key: "4b58e0fc90a55ec182e14efcb2b9983d"
server_key_iv: "9f5704df4681c6b9d660b5cbf1bad959"
server_key_version: "encryptionkey@0"
I20260805 22:41:49.065174 9890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:49.082136 9890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:49.085610 9890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:49.085754 9890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:49.090098 9890 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:46727
I20260805 22:41:49.090281 9958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:46727 every 8 connection(s)
I20260805 22:41:49.090700 9890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:49.091771 9959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:49.094270 9959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4: Bootstrap starting.
I20260805 22:41:49.094949 9959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:49.095322 9959 log.cc:824] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:49.096529 9959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4: No bootstrap required, opened a new log
I20260805 22:41:49.097084 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 9890
I20260805 22:41:49.097229 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:49.097427 19766 external_mini_cluster.cc:1428] Setting key 6172cad6ba8f74eba8cb64d69893b217
I20260805 22:41:49.099465 9959 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ade8c809f674142b282109d98768ac4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46727 } }
I20260805 22:41:49.099696 9959 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:49.099746 9959 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ade8c809f674142b282109d98768ac4, State: Initialized, Role: FOLLOWER
I20260805 22:41:49.099912 9959 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ade8c809f674142b282109d98768ac4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46727 } }
I20260805 22:41:49.100023 9959 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:49.100061 9959 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:49.100103 9959 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:49.100975 9959 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ade8c809f674142b282109d98768ac4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46727 } }
I20260805 22:41:49.101094 9959 leader_election.cc:302] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ade8c809f674142b282109d98768ac4; no voters:
I20260805 22:41:49.101270 9959 leader_election.cc:288] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:49.101361 9964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:49.101554 9959 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:49.101595 9964 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [term 1 LEADER]: Becoming Leader. State: Replica: 2ade8c809f674142b282109d98768ac4, State: Running, Role: LEADER
I20260805 22:41:49.101809 9964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ade8c809f674142b282109d98768ac4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46727 } }
I20260805 22:41:49.102257 9965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ade8c809f674142b282109d98768ac4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ade8c809f674142b282109d98768ac4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46727 } } }
I20260805 22:41:49.102356 9965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:49.102603 9966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ade8c809f674142b282109d98768ac4. Latest consensus state: current_term: 1 leader_uuid: "2ade8c809f674142b282109d98768ac4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ade8c809f674142b282109d98768ac4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46727 } } }
I20260805 22:41:49.102746 9966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:49.103055 9973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:49.103713 9973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:49.105195 9963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:49.098033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48237 (local address 127.19.77.190:46727)
0805 22:41:49.098254 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:49.098263 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:49.098292 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:41:49.099384 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:49.099392 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:49.099453 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:49.099587 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:49.099904 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:49.101321 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:49.102509 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:49.103231 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:49.103323 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:49.104430 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:49.104435 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:49.104435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:49.104660 (+ 225us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:49.104703 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:49.104719 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:49.104783 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:49.104887 (+ 104us) server_negotiation.cc:299] Negotiation successful
0805 22:41:49.104958 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":114,"threads_started":1}
I20260805 22:41:49.105593 9973 catalog_manager.cc:1347] Generated new cluster ID: 482cdd83c3354f5d935a76c122b879c0
I20260805 22:41:49.105655 9973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:49.106156 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:49.114423 9963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:49.107677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58175 (local address 127.19.77.190:46727)
0805 22:41:49.107722 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:49.107725 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:49.111426 (+ 3701us) server_negotiation.cc:407] Connection header received
0805 22:41:49.111520 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:49.111521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:49.111534 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:49.111583 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:49.111754 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:49.112247 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:49.112993 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:49.113208 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:49.113291 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:49.114116 (+ 825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:49.114118 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:49.114118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:49.114124 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:49.114141 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:49.114145 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:49.114224 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:49.114287 (+ 63us) server_negotiation.cc:299] Negotiation successful
0805 22:41:49.114312 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:41:49.118850 9973 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:49.119567 9973 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:49.122498 9973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ade8c809f674142b282109d98768ac4: Generated new TSK 0
I20260805 22:41:49.122722 9973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:49.126341 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 9890
2026-08-05T22:41:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1378 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:49 dist-test-slave-chsk krb5kdc[9990](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:49 dist-test-slave-chsk krb5kdc[9990](info): set up 2 sockets
Aug 05 22:41:49 dist-test-slave-chsk krb5kdc[9990](info): commencing operation
krb5kdc: starting...
W20260805 22:41:50.191044 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:50 dist-test-slave-chsk krb5kdc[9990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:50.322391 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:46487
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:34623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:46487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:50.408228 10006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:50.408468 10006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:50.408494 10006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:50.409680 10006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:50.409731 10006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:50.409746 10006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:50.409759 10006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:50.409772 10006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:50.411317 10006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:34623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:46487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:46487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:50.411541 10006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:50.411743 10006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:50.416894 10014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:50.416894 10011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:50.417017 10006 server_base.cc:1034] running on GCE node
W20260805 22:41:50.416894 10012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:50.417414 10006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:50.417737 10006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:50.418943 10006 hybrid_clock.cc:648] HybridClock initialized: now 1785969710418926 us; error 31 us; skew 500 ppm
Aug 05 22:41:50 dist-test-slave-chsk krb5kdc[9990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969710, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:50.421761 10006 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:50.422228 10006 webserver.cc:460] Webserver started at http://127.19.77.190:40309/ using document root <none> and password file <none>
I20260805 22:41:50.422482 10006 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:50.422559 10006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:50.422725 10006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:50.423931 10006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "c51f60bbdea24be6b6e9637860b4acdd"
format_stamp: "Formatted at 2026-08-05 22:41:50 on dist-test-slave-chsk"
server_key: "6c0b01d877973dbccbd06883a0a69dd9"
server_key_iv: "d4f0e9cef166f8664552a294b8980d96"
server_key_version: "encryptionkey@0"
I20260805 22:41:50.424337 10006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "c51f60bbdea24be6b6e9637860b4acdd"
format_stamp: "Formatted at 2026-08-05 22:41:50 on dist-test-slave-chsk"
server_key: "6c0b01d877973dbccbd06883a0a69dd9"
server_key_iv: "d4f0e9cef166f8664552a294b8980d96"
server_key_version: "encryptionkey@0"
I20260805 22:41:50.425954 10006 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:41:50.426864 10021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:50.427090 10006 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:50.427250 10006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "c51f60bbdea24be6b6e9637860b4acdd"
format_stamp: "Formatted at 2026-08-05 22:41:50 on dist-test-slave-chsk"
server_key: "6c0b01d877973dbccbd06883a0a69dd9"
server_key_iv: "d4f0e9cef166f8664552a294b8980d96"
server_key_version: "encryptionkey@0"
I20260805 22:41:50.427342 10006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:50.431062 10006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:50.433699 10006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:50.433871 10006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:50.438185 10006 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:46487
I20260805 22:41:50.438251 10074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:46487 every 8 connection(s)
I20260805 22:41:50.438691 10006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:50.439850 10075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:50.442232 10075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd: Bootstrap starting.
I20260805 22:41:50.442922 10075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:50.443254 10075 log.cc:824] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:50.444065 10075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd: No bootstrap required, opened a new log
I20260805 22:41:50.445683 10075 raft_consensus.cc:348] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51f60bbdea24be6b6e9637860b4acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46487 } }
I20260805 22:41:50.445834 10075 raft_consensus.cc:374] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:41:50.445858 10075 raft_consensus.cc:729] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51f60bbdea24be6b6e9637860b4acdd, State: Initialized, Role: FOLLOWER
I20260805 22:41:50.446007 10075 consensus_queue.cc:260] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51f60bbdea24be6b6e9637860b4acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46487 } }
I20260805 22:41:50.446097 10075 raft_consensus.cc:388] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:41:50.446122 10075 raft_consensus.cc:482] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:41:50.446151 10075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:50.447003 10075 raft_consensus.cc:504] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51f60bbdea24be6b6e9637860b4acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46487 } }
I20260805 22:41:50.447104 10075 leader_election.cc:302] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c51f60bbdea24be6b6e9637860b4acdd; no voters:
I20260805 22:41:50.447309 10075 leader_election.cc:288] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:41:50.447389 10078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:50.447577 10078 raft_consensus.cc:686] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [term 1 LEADER]: Becoming Leader. State: Replica: c51f60bbdea24be6b6e9637860b4acdd, State: Running, Role: LEADER
I20260805 22:41:50.447607 10075 sys_catalog.cc:564] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:50.447708 10078 consensus_queue.cc:237] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51f60bbdea24be6b6e9637860b4acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46487 } }
I20260805 22:41:50.448153 10080 sys_catalog.cc:455] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c51f60bbdea24be6b6e9637860b4acdd. Latest consensus state: current_term: 1 leader_uuid: "c51f60bbdea24be6b6e9637860b4acdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51f60bbdea24be6b6e9637860b4acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46487 } } }
I20260805 22:41:50.448294 10080 sys_catalog.cc:458] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:50.448153 10079 sys_catalog.cc:455] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c51f60bbdea24be6b6e9637860b4acdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51f60bbdea24be6b6e9637860b4acdd" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 46487 } } }
I20260805 22:41:50.448346 10079 sys_catalog.cc:458] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:50.448527 10087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:50.448838 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 10006
I20260805 22:41:50.448968 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:50.449183 19766 external_mini_cluster.cc:1428] Setting key 46212bf25dbd1796e1fa42a98a8cb7f3
I20260805 22:41:50.449388 10087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:50.451735 10087 catalog_manager.cc:1347] Generated new cluster ID: 5562bc0f52c94c6faf32c40140405c71
I20260805 22:41:50.451817 10087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:50.452241 10096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:50.449780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59201 (local address 127.19.77.190:46487)
0805 22:41:50.450219 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:50.450229 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:50.450262 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:41:50.450398 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:50.450406 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:50.450439 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:50.450584 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:50.451691 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:50.451695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:50.451695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:50.451700 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:50.451745 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:50.451760 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:50.451824 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:50.452006 (+ 182us) server_negotiation.cc:299] Negotiation successful
0805 22:41:50.452052 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":74,"threads_started":1}
I20260805 22:41:50.453377 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:50.456243 10096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:50.455056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42435 (local address 127.19.77.190:46487)
0805 22:41:50.455104 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:50.455106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:50.455256 (+ 150us) server_negotiation.cc:407] Connection header received
0805 22:41:50.455335 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:50.455336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:50.455342 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:50.455389 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:50.456007 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:50.456008 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:50.456009 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:41:50.456013 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:50.456030 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:41:50.456035 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:50.456093 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:50.456161 (+ 68us) server_negotiation.cc:299] Negotiation successful
0805 22:41:50.456174 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:41:50.466043 10087 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:50.466253 10087 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:50.468940 10087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c51f60bbdea24be6b6e9637860b4acdd: Generated new TSK 0
I20260805 22:41:50.469159 10087 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:41:50.472632 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 10006
2026-08-05T22:41:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1346 ms)
[----------] 18 tests from AuthTokenIssuingTest (24684 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:50 dist-test-slave-chsk krb5kdc[10106](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:50 dist-test-slave-chsk krb5kdc[10106](info): set up 2 sockets
Aug 05 22:41:50 dist-test-slave-chsk krb5kdc[10106](info): commencing operation
krb5kdc: starting...
W20260805 22:41:51.548978 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:51 dist-test-slave-chsk krb5kdc[10106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:51.682715 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:39053
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:39053,127.19.77.189:45349,127.19.77.188:41019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:51.773211 10119 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:41:51.773511 10119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:51.773542 10119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:51.773589 10119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:51.774825 10119 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:51.774906 10119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:51.774935 10119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:51.774968 10119 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:51.774992 10119 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:51.776734 10119 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:39053,127.19.77.189:45349,127.19.77.188:41019
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:39053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:51.777073 10119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:51.777338 10119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:51.782577 10124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:51.782586 10125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:51.782840 10119 server_base.cc:1034] running on GCE node
W20260805 22:41:51.782605 10127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:51.783216 10119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:51.783551 10119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:51.784725 10119 hybrid_clock.cc:648] HybridClock initialized: now 1785969711784696 us; error 42 us; skew 500 ppm
Aug 05 22:41:51 dist-test-slave-chsk krb5kdc[10106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:51.787468 10119 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:51.787963 10119 webserver.cc:460] Webserver started at http://127.19.77.190:44259/ using document root <none> and password file <none>
I20260805 22:41:51.788233 10119 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:51.788311 10119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:51.788477 10119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:51.789697 10119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "026673e6bf1f43d78d841cb4279c09d4"
format_stamp: "Formatted at 2026-08-05 22:41:51 on dist-test-slave-chsk"
server_key: "f7002b41c075885b5b2e5b62cb289bad"
server_key_iv: "11ef99957abac389efddceb92ecfffb1"
server_key_version: "encryptionkey@0"
I20260805 22:41:51.790069 10119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "026673e6bf1f43d78d841cb4279c09d4"
format_stamp: "Formatted at 2026-08-05 22:41:51 on dist-test-slave-chsk"
server_key: "f7002b41c075885b5b2e5b62cb289bad"
server_key_iv: "11ef99957abac389efddceb92ecfffb1"
server_key_version: "encryptionkey@0"
I20260805 22:41:51.791556 10119 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:51.792382 10134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:51.792570 10119 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:51.792687 10119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "026673e6bf1f43d78d841cb4279c09d4"
format_stamp: "Formatted at 2026-08-05 22:41:51 on dist-test-slave-chsk"
server_key: "f7002b41c075885b5b2e5b62cb289bad"
server_key_iv: "11ef99957abac389efddceb92ecfffb1"
server_key_version: "encryptionkey@0"
I20260805 22:41:51.792769 10119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:51.805420 10119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:51.808068 10119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:51.808269 10119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:51.812963 10119 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:39053
I20260805 22:41:51.813006 10188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:39053 every 8 connection(s)
I20260805 22:41:51.813421 10119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:51.814500 10189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:51.816273 10189 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:51.819397 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 10119
I20260805 22:41:51.819547 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:51.819732 19766 external_mini_cluster.cc:1428] Setting key dd2a016bea5fa27171047148e102b187
Aug 05 22:41:51 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.189@KRBTEST.COM; defaulting to no policy
I20260805 22:41:51.830152 10193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:51.817206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44000 (local address 127.19.77.190:39053)
0805 22:41:51.817415 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:51.817426 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:51.817569 (+ 143us) server_negotiation.cc:407] Connection header received
0805 22:41:51.818171 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:51.818173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:51.818201 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:51.818308 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:51.818914 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:51.820235 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:51.821208 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:51.821779 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:51.821934 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:51.825291 (+ 3357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:51.825303 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:51.825304 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:51.825315 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:51.827921 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:51.828418 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:51.828422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:51.828422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:51.828543 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:51.829046 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:51.829048 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:51.829048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:51.829419 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:51.829506 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:51.829779 (+ 273us) server_negotiation.cc:299] Negotiation successful
0805 22:41:51.829892 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":88,"threads_started":1}
I20260805 22:41:51.830185 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:51.817109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:39053 (local address 127.0.0.1:44000)
0805 22:41:51.817404 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:51.817454 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:51.817999 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:51.818315 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:51.818317 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:51.818626 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:51.818795 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:51.818799 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:51.820353 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:51.820355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:51.821098 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:51.821101 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:51.821907 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:51.821909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:51.821991 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:51.822879 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:51.822893 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:51.825169 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:51.828047 (+ 2878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:51.828057 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:51.828059 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:51.828307 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:51.828689 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:51.828691 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:51.828691 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:51.828884 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:51.829536 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:51.829543 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:51.829627 (+ 84us) client_negotiation.cc:769] Sending connection context
0805 22:41:51.829728 (+ 101us) client_negotiation.cc:240] Negotiation successful
0805 22:41:51.829977 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":91,"thread_start_us":155,"threads_started":1}
I20260805 22:41:51.831063 10189 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:51.831550 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:51.831405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:45349 (local address 127.0.0.1:40094)
0805 22:41:51.831470 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:51.831523 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:45349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260805 22:41:51.831720 10136 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.77.189:45349: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.189@KRBTEST.COM" created.
I20260805 22:41:51.832306 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:51.832203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:45349 (local address 127.0.0.1:40096)
0805 22:41:51.832240 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:51.832275 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:45349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260805 22:41:51.832419 10189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.189:45349: Network error: Client connection negotiation failed: client connection to 127.19.77.189:45349: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab.
Entry for principal kudu/127.19.77.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab.
I20260805 22:41:51.851212 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.189:45349
--webserver_interface=127.19.77.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab
--principal=kudu/127.19.77.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:39053,127.19.77.189:45349,127.19.77.188:41019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:41:51.881702 10189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } attempt: 1
I20260805 22:41:51.882259 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:51.882116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:45349 (local address 127.0.0.1:40098)
0805 22:41:51.882183 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:51.882226 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:45349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 22:41:51.882679 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:51.882534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:45349 (local address 127.0.0.1:40110)
0805 22:41:51.882601 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:51.882648 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:45349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260805 22:41:51.882818 10189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.189:45349: Network error: Client connection negotiation failed: client connection to 127.19.77.189:45349: connect: Connection refused (error 111)
W20260805 22:41:51.937642 10197 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:41:51.937889 10197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:51.937907 10197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:51.937930 10197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:51.939236 10197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:51.939291 10197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:51.939306 10197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:51.939318 10197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:51.939330 10197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:51.941000 10197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:39053,127.19.77.189:45349,127.19.77.188:41019
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab
--principal=kudu/127.19.77.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.189:45349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.77.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:51.941308 10197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:51.941589 10197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:51.946799 10205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:51.946803 10203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:51.947050 10197 server_base.cc:1034] running on GCE node
W20260805 22:41:51.946799 10202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:51.947445 10197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:51.947798 10197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:51.949005 10197 hybrid_clock.cc:648] HybridClock initialized: now 1785969711948997 us; error 38 us; skew 500 ppm
I20260805 22:41:51.950968 10189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } attempt: 2
I20260805 22:41:51.951479 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:51.951310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:45349 (local address 127.0.0.1:40118)
0805 22:41:51.951390 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:51.951432 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:45349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
Aug 05 22:41:51 dist-test-slave-chsk krb5kdc[10106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:51.951891 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:51.951772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:45349 (local address 127.0.0.1:40130)
0805 22:41:51.951832 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:51.951863 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:45349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260805 22:41:51.952000 10189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.189:45349: Network error: Client connection negotiation failed: client connection to 127.19.77.189:45349: connect: Connection refused (error 111)
I20260805 22:41:51.952090 10197 init.cc:377] Logged in from keytab as kudu/127.19.77.189@KRBTEST.COM (short username kudu)
I20260805 22:41:51.952623 10197 webserver.cc:460] Webserver started at http://127.19.77.189:45651/ using document root <none> and password file <none>
I20260805 22:41:51.952878 10197 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:51.952927 10197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:51.953094 10197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:51.954267 10197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/data/instance:
uuid: "c49ca63bab414ca3bf568df67a07c951"
format_stamp: "Formatted at 2026-08-05 22:41:51 on dist-test-slave-chsk"
server_key: "38f2234f0515acbee17b809062102bb8"
server_key_iv: "795a6db2e9e753fbf9d2b1c594056d88"
server_key_version: "encryptionkey@0"
I20260805 22:41:51.954674 10197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/wal/instance:
uuid: "c49ca63bab414ca3bf568df67a07c951"
format_stamp: "Formatted at 2026-08-05 22:41:51 on dist-test-slave-chsk"
server_key: "38f2234f0515acbee17b809062102bb8"
server_key_iv: "795a6db2e9e753fbf9d2b1c594056d88"
server_key_version: "encryptionkey@0"
I20260805 22:41:51.956312 10197 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260805 22:41:51.957293 10212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:51.957507 10197 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:51.957608 10197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/wal
uuid: "c49ca63bab414ca3bf568df67a07c951"
format_stamp: "Formatted at 2026-08-05 22:41:51 on dist-test-slave-chsk"
server_key: "38f2234f0515acbee17b809062102bb8"
server_key_iv: "795a6db2e9e753fbf9d2b1c594056d88"
server_key_version: "encryptionkey@0"
I20260805 22:41:51.957692 10197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:51.998356 10197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:52.000752 10197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:52.000909 10197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:52.005489 10197 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.189:45349
I20260805 22:41:52.005532 10265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.189:45349 every 8 connection(s)
I20260805 22:41:52.005926 10197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
I20260805 22:41:52.007006 10266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:52.007870 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 10197
I20260805 22:41:52.007979 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-1/wal/instance
I20260805 22:41:52.008188 19766 external_mini_cluster.cc:1428] Setting key 12d809652f3f8694cb51aaba483a0192
I20260805 22:41:52.009589 10266 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.188@KRBTEST.COM; defaulting to no policy
I20260805 22:41:52.020524 10193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.010758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44006 (local address 127.19.77.190:39053)
0805 22:41:52.010824 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.010830 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.011109 (+ 279us) server_negotiation.cc:407] Connection header received
0805 22:41:52.011675 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.011677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.011693 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.011762 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.012470 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.013302 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.014335 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.014718 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.014804 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.017174 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.017176 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.017176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.017186 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.018759 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.019320 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.019321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.019321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.019382 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.019791 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.019792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.019792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.019936 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.019997 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.020362 (+ 365us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.020451 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:41:52.020726 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.010730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:39053 (local address 127.0.0.1:44006)
0805 22:41:52.010957 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.010998 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:52.011552 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:52.011825 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:52.011828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:52.012097 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:52.012360 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.012365 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.013407 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.013408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.014231 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.014233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.014829 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.014830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.014941 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.015553 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:52.015562 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:52.017039 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:52.018872 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.018883 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.018886 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.019239 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.019451 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.019452 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.019452 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.019660 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.020015 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:52.020022 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:52.020168 (+ 146us) client_negotiation.cc:769] Sending connection context
0805 22:41:52.020301 (+ 133us) client_negotiation.cc:240] Negotiation successful
0805 22:41:52.020455 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":133,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.188@KRBTEST.COM" created.
I20260805 22:41:52.021318 10266 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
I20260805 22:41:52.030977 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.023049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:45349 (local address 127.0.0.1:40132)
0805 22:41:52.023106 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.023117 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:52.023206 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:52.023511 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:52.023512 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:52.023681 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:52.023737 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.023739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.024641 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.024642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.025232 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.025234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.025733 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.025734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.025803 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.026314 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:52.026320 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:52.027669 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:52.029735 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.029736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.029736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.029915 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.030214 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.030215 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.030216 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.030283 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.030593 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:52.030593 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:52.030676 (+ 83us) client_negotiation.cc:769] Sending connection context
0805 22:41:52.030746 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 22:41:52.030885 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260805 22:41:52.031075 10272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.023171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40132 (local address 127.19.77.189:45349)
0805 22:41:52.023352 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.023357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.023377 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:41:52.023397 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.023399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.023410 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.023503 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.023813 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.024526 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.025312 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.025650 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.025738 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.027773 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.027791 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.027791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.027798 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.029605 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.030006 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.030009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.030009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.030101 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.030357 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.030358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.030358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.030527 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.030603 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.030807 (+ 204us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.030942 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":154,"thread_start_us":98,"threads_started":1}
I20260805 22:41:52.031822 10266 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:52.032251 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.032124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33226)
0805 22:41:52.032176 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.032227 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260805 22:41:52.032397 10217 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
I20260805 22:41:52.032904 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.032802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33234)
0805 22:41:52.032854 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.032886 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260805 22:41:52.033015 10266 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:41019: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab.
Entry for principal kudu/127.19.77.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab.
I20260805 22:41:52.037809 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.188:41019
--webserver_interface=127.19.77.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab
--principal=kudu/127.19.77.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:39053,127.19.77.189:45349,127.19.77.188:41019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:41:52.043201 10189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } attempt: 3
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
I20260805 22:41:52.052661 10272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.043725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40134 (local address 127.19.77.189:45349)
0805 22:41:52.043807 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.043810 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.043822 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:41:52.043857 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.043858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.043872 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.043962 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.044321 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.045156 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.045895 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.046291 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.046378 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.049262 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.049265 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.049265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.049276 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.051274 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.051753 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.051754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.051755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.051831 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.052030 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.052030 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.052031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.052211 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.052268 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.052490 (+ 222us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.052590 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260805 22:41:52.052661 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.043576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:45349 (local address 127.0.0.1:40134)
0805 22:41:52.043642 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.043658 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:52.043712 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:52.043987 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:52.043988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:52.044159 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:52.044229 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.044231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.045274 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.045275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.045801 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.045802 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.046378 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.046379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.046437 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.047051 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:52.047129 (+ 78us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:52.049054 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:52.051385 (+ 2331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.051387 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.051388 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.051659 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.051895 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.051896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.051896 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.051967 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.052278 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:52.052279 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:52.052346 (+ 67us) client_negotiation.cc:769] Sending connection context
0805 22:41:52.052420 (+ 74us) client_negotiation.cc:240] Negotiation successful
0805 22:41:52.052545 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260805 22:41:52.053344 10189 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:52.053846 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.053646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33236)
0805 22:41:52.053701 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.053737 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260805 22:41:52.054272 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.054172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33240)
0805 22:41:52.054221 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.054253 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260805 22:41:52.054363 10189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:41019: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
I20260805 22:41:52.082365 10266 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } attempt: 1
I20260805 22:41:52.083184 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.082936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33248)
0805 22:41:52.083035 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.083114 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260805 22:41:52.083765 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.083588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33258)
0805 22:41:52.083662 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.083715 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260805 22:41:52.084218 10266 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:41019: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
I20260805 22:41:52.085520 10189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } attempt: 1
I20260805 22:41:52.085981 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.085853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33262)
0805 22:41:52.085915 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.085954 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260805 22:41:52.086416 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.086330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33268)
0805 22:41:52.086373 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.086398 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260805 22:41:52.086532 10189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:41019: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
W20260805 22:41:52.131433 10274 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:41:52.131695 10274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:52.131714 10274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:52.131788 10274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:52.133093 10274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:52.133158 10274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:52.133173 10274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:52.133186 10274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:52.133199 10274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:52.135643 10274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:39053,127.19.77.189:45349,127.19.77.188:41019
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab
--principal=kudu/127.19.77.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.188:41019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.77.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:52.136018 10274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:52.136324 10274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:52.142833 10280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:52.142833 10279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:52.142915 10282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:52.143312 10274 server_base.cc:1034] running on GCE node
I20260805 22:41:52.143648 10274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:52.143980 10274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:52.145172 10274 hybrid_clock.cc:648] HybridClock initialized: now 1785969712145157 us; error 32 us; skew 500 ppm
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969712, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:52.148277 10274 init.cc:377] Logged in from keytab as kudu/127.19.77.188@KRBTEST.COM (short username kudu)
I20260805 22:41:52.149008 10274 webserver.cc:460] Webserver started at http://127.19.77.188:39961/ using document root <none> and password file <none>
I20260805 22:41:52.149326 10274 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:52.149411 10274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:52.149605 10274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:52.151324 10274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/data/instance:
uuid: "935ece20ef7b4486b10e85f0841fb188"
format_stamp: "Formatted at 2026-08-05 22:41:52 on dist-test-slave-chsk"
server_key: "920e5d33b33a2da0e2e4b051bdced132"
server_key_iv: "3a0330b374d95bdbdf53d2cd749f3690"
server_key_version: "encryptionkey@0"
I20260805 22:41:52.151829 10274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/wal/instance:
uuid: "935ece20ef7b4486b10e85f0841fb188"
format_stamp: "Formatted at 2026-08-05 22:41:52 on dist-test-slave-chsk"
server_key: "920e5d33b33a2da0e2e4b051bdced132"
server_key_iv: "3a0330b374d95bdbdf53d2cd749f3690"
server_key_version: "encryptionkey@0"
I20260805 22:41:52.152397 10266 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } attempt: 2
I20260805 22:41:52.152902 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.152745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33270)
0805 22:41:52.152828 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.152871 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260805 22:41:52.153357 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.153266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33284)
0805 22:41:52.153310 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.153337 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260805 22:41:52.153484 10266 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:41019: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
I20260805 22:41:52.153812 10274 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260805 22:41:52.154749 10289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:52.154999 10274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:41:52.155104 10274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/wal
uuid: "935ece20ef7b4486b10e85f0841fb188"
format_stamp: "Formatted at 2026-08-05 22:41:52 on dist-test-slave-chsk"
server_key: "920e5d33b33a2da0e2e4b051bdced132"
server_key_iv: "3a0330b374d95bdbdf53d2cd749f3690"
server_key_version: "encryptionkey@0"
I20260805 22:41:52.155210 10274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:52.161691 10189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } attempt: 2
I20260805 22:41:52.162231 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.162046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33290)
0805 22:41:52.162125 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.162174 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260805 22:41:52.162608 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.162524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33292)
0805 22:41:52.162564 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.162592 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260805 22:41:52.162714 10189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:41019: Network error: Client connection negotiation failed: client connection to 127.19.77.188:41019: connect: Connection refused (error 111)
I20260805 22:41:52.164410 10274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:52.166782 10274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:52.167006 10274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:52.172237 10274 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.188:41019
I20260805 22:41:52.172293 10343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.188:41019 every 8 connection(s)
I20260805 22:41:52.172711 10274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
I20260805 22:41:52.173786 10344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:52.174239 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 10274
I20260805 22:41:52.174361 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785969428667539-19766-0/minicluster-data/master-2/wal/instance
I20260805 22:41:52.174557 19766 external_mini_cluster.cc:1428] Setting key b82477199910078ac8ce9a7b97e4fb18
I20260805 22:41:52.175976 10344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969712, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
I20260805 22:41:52.187026 10193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.176785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44014 (local address 127.19.77.190:39053)
0805 22:41:52.176842 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.176844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.177038 (+ 194us) server_negotiation.cc:407] Connection header received
0805 22:41:52.177107 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.177108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.177120 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.177197 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.177725 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.178413 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.179734 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.180012 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.180100 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.182928 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.182930 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.182931 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.182942 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.185123 (+ 2181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.185904 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.185906 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.185906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.185991 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.186273 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.186275 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.186275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.186423 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.186512 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.186816 (+ 304us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.186924 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260805 22:41:52.187269 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.176652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:39053 (local address 127.0.0.1:44014)
0805 22:41:52.176915 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.176964 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:52.177036 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:52.177220 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:52.177222 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:52.177514 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:52.177629 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.177635 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.178517 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.178518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.179655 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.179659 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.180189 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.180190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.180267 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.180873 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:52.180903 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:52.182804 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:52.185279 (+ 2475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.185287 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.185290 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.185744 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.186072 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.186073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.186073 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.186191 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.186500 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:52.186508 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:52.186671 (+ 163us) client_negotiation.cc:769] Sending connection context
0805 22:41:52.186791 (+ 120us) client_negotiation.cc:240] Negotiation successful
0805 22:41:52.186977 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":25,"thread_start_us":129,"threads_started":1}
I20260805 22:41:52.187430 10347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.175347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33304 (local address 127.19.77.188:41019)
0805 22:41:52.175552 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.175560 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.175593 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:41:52.176022 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.176029 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.176077 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.176243 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.177077 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.178361 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.179577 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.180045 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.180173 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.183497 (+ 3324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.183517 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.183517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.183530 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.185758 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.186432 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.186436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.186436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.186499 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.186731 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.186732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.186732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.186900 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.187100 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.187209 (+ 109us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.187306 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260805 22:41:52.188181 10344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969712, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:52.197525 10272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.188589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40148 (local address 127.19.77.189:45349)
0805 22:41:52.188635 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.188637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.188735 (+ 98us) server_negotiation.cc:407] Connection header received
0805 22:41:52.188811 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.188812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.188822 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.188878 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.189251 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.189921 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.191272 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.191562 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.191643 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.194069 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.194071 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.194072 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.194087 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.195771 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.196145 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.196147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.196147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.196222 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.196453 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.196454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.196455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.196624 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.196698 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.197308 (+ 610us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.197413 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260805 22:41:52.197525 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.188512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:45349 (local address 127.0.0.1:40148)
0805 22:41:52.188666 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.188676 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:52.188748 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:52.188882 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:52.188883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:52.189068 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:52.189150 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.189152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.190071 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.190074 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.191128 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.191184 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.191672 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.191673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.191787 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.192411 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:52.192417 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:52.193957 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:52.195880 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.195881 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.195882 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.196069 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.196305 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.196306 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.196306 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.196368 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.196735 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:52.196737 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:52.196966 (+ 229us) client_negotiation.cc:769] Sending connection context
0805 22:41:52.197275 (+ 309us) client_negotiation.cc:240] Negotiation successful
0805 22:41:52.197413 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260805 22:41:52.198660 10344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:52.199064 10193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.188816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44030 (local address 127.19.77.190:39053)
0805 22:41:52.188874 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.188876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.188884 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:41:52.188905 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.188906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.188915 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.188977 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.189543 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.190180 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.191388 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.191674 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.191747 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.194743 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.194745 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.194745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.194756 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.197028 (+ 2272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.197948 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.197949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.197950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.198027 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.198294 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.198296 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.198296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.198466 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.198694 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.198730 (+ 36us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.198848 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969712, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
I20260805 22:41:52.207280 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.199005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33314)
0805 22:41:52.199067 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.199079 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:52.199128 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:52.199313 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:52.199314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:52.199467 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:52.199503 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.199504 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.200511 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.200512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.201026 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.201028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.201493 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.201494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.201544 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.202065 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:52.202071 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:52.203499 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:52.206015 (+ 2516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.206017 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.206017 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.206201 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.206434 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.206435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.206435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.206488 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.206802 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:52.206803 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:52.206858 (+ 55us) client_negotiation.cc:769] Sending connection context
0805 22:41:52.206941 (+ 83us) client_negotiation.cc:240] Negotiation successful
0805 22:41:52.207074 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260805 22:41:52.207377 10347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.199088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33314 (local address 127.19.77.188:41019)
0805 22:41:52.199125 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.199127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.199136 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:52.199225 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.199226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.199235 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.199262 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.199593 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.200403 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.201165 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.201400 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.201493 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.203609 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.203610 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.203610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.203617 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.205907 (+ 2290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.206291 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.206293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.206293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.206358 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.206554 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.206556 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.206556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.206722 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.206791 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.206975 (+ 184us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.207191 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":92,"server-negotiator.queue_time_us":20}
I20260805 22:41:52.208498 10272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.199838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40160 (local address 127.19.77.189:45349)
0805 22:41:52.199875 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.199877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.199886 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:52.199921 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.199922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.199937 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.199974 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.200575 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.201035 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.201725 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.201962 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.202041 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.204733 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.204734 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.204734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.204742 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.206668 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.207105 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.207106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.207107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.207199 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.207566 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.207568 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.207568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.207731 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.207920 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.208192 (+ 272us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.208294 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260805 22:41:52.209311 10344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188: Bootstrap starting.
I20260805 22:41:52.210443 10344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:52.210482 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:52.210775 10344 log.cc:824] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:52.211743 10344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188: No bootstrap required, opened a new log
I20260805 22:41:52.211743 10162 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "026673e6bf1f43d78d841cb4279c09d4"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44030
I20260805 22:41:52.213932 10344 raft_consensus.cc:348] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } }
I20260805 22:41:52.214121 10344 raft_consensus.cc:729] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 935ece20ef7b4486b10e85f0841fb188, State: Initialized, Role: FOLLOWER
I20260805 22:41:52.214207 10344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } }
I20260805 22:41:52.214540 10350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } } }
I20260805 22:41:52.214597 10344 sys_catalog.cc:564] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:52.214670 10350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:41:52.216768 10361 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:41:52.216843 10361 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:41:52.217224 10274 master_runner.cc:186] Error getting master registration for 127.19.77.190:39053: OK, instance_id { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" instance_seqno: 1785969711811636 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:41:52.219601 10274 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:41:52.244597 10266 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } attempt: 3
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
I20260805 22:41:52.254750 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.245043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33324)
0805 22:41:52.245105 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.245121 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:52.245183 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:52.245418 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:52.245419 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:52.245685 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:52.245749 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.245752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.246796 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.246797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.248733 (+ 1936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.248737 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.249191 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.249192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.249253 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.249817 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:52.249823 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:52.251351 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:52.253405 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.253407 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.253408 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.253687 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.253939 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.253940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.253941 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.254008 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.254385 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:52.254385 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:52.254440 (+ 55us) client_negotiation.cc:769] Sending connection context
0805 22:41:52.254512 (+ 72us) client_negotiation.cc:240] Negotiation successful
0805 22:41:52.254627 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260805 22:41:52.254750 10347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.245166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33324 (local address 127.19.77.188:41019)
0805 22:41:52.245242 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.245245 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.245256 (+ 11us) server_negotiation.cc:407] Connection header received
0805 22:41:52.245288 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.245289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.245300 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.245386 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.245919 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.246688 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.248857 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.249083 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.249171 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.251470 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.251472 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.251472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.251483 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.253288 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.253774 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.253775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.253775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.253844 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.254079 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.254079 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.254080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.254309 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.254387 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.254553 (+ 166us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.254652 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260805 22:41:52.256870 10266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951: Bootstrap starting.
I20260805 22:41:52.257709 10266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:52.258050 10266 log.cc:824] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:52.259027 10266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951: No bootstrap required, opened a new log
I20260805 22:41:52.261377 10266 raft_consensus.cc:348] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } }
I20260805 22:41:52.261554 10266 raft_consensus.cc:729] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49ca63bab414ca3bf568df67a07c951, State: Initialized, Role: FOLLOWER
I20260805 22:41:52.261651 10266 consensus_queue.cc:260] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } }
I20260805 22:41:52.261806 10189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } attempt: 3
I20260805 22:41:52.262055 10266 sys_catalog.cc:564] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:52.262001 10364 sys_catalog.cc:455] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } } }
I20260805 22:41:52.262106 10364 sys_catalog.cc:458] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [sys.catalog]: This master's current role is: FOLLOWER
Aug 05 22:41:52 dist-test-slave-chsk krb5kdc[10106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969711, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
I20260805 22:41:52.265442 10197 master_runner.cc:186] Error getting master registration for 127.19.77.190:39053: OK, instance_id { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" instance_seqno: 1785969711811636 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:41:52.269069 10197 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:41:52.270275 10347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.262322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33330 (local address 127.19.77.188:41019)
0805 22:41:52.262399 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.262401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.262409 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:41:52.262437 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.262437 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.262447 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.262503 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.262895 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.263471 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.264506 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.264802 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.264876 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.267214 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.267215 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.267216 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.267243 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.268991 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.269420 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.269421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.269422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.269477 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.269695 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.269697 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.269697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.269846 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.269916 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.270082 (+ 166us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.270168 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 22:41:52.270278 10192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.262172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:41019 (local address 127.0.0.1:33330)
0805 22:41:52.262217 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:52.262231 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:52.262286 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:52.262532 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:52.262533 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:52.262758 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:52.262811 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.262813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.263561 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.263562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.264400 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:52.264403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.264892 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.264893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:52.264967 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.265441 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:52.265447 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:52.267069 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:52.269101 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.269103 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.269103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.269343 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.269540 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:52.269557 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:52.269558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:52.269620 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:52.269920 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:52.269921 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:52.269977 (+ 56us) client_negotiation.cc:769] Sending connection context
0805 22:41:52.270060 (+ 83us) client_negotiation.cc:240] Negotiation successful
0805 22:41:52.270171 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
W20260805 22:41:52.271926 10376 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260805 22:41:52.272003 10189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4: Bootstrap starting.
W20260805 22:41:52.272054 10376 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:41:52.272704 10189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:52.273018 10189 log.cc:824] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:52.273851 10189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4: No bootstrap required, opened a new log
I20260805 22:41:52.275352 10189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } }
I20260805 22:41:52.275507 10189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 026673e6bf1f43d78d841cb4279c09d4, State: Initialized, Role: FOLLOWER
I20260805 22:41:52.275601 10189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } }
I20260805 22:41:52.275940 10189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:52.275974 10162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260805 22:41:52.276018 10162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:52.277032 10162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } }
I20260805 22:41:52.277972 10240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "026673e6bf1f43d78d841cb4279c09d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c49ca63bab414ca3bf568df67a07c951"
I20260805 22:41:52.277956 10318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "026673e6bf1f43d78d841cb4279c09d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "935ece20ef7b4486b10e85f0841fb188"
I20260805 22:41:52.278092 10240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:52.278092 10318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:52.279042 10318 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 026673e6bf1f43d78d841cb4279c09d4 in term 1.
I20260805 22:41:52.279042 10240 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 026673e6bf1f43d78d841cb4279c09d4 in term 1.
I20260805 22:41:52.279345 10136 leader_election.cc:302] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 026673e6bf1f43d78d841cb4279c09d4, c49ca63bab414ca3bf568df67a07c951; no voters:
I20260805 22:41:52.275907 10379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } } }
I20260805 22:41:52.277340 10162 leader_election.cc:288] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [CANDIDATE]: Term 1 election: Requested vote from peers c49ca63bab414ca3bf568df67a07c951 (127.19.77.189:45349), 935ece20ef7b4486b10e85f0841fb188 (127.19.77.188:41019)
I20260805 22:41:52.280056 10379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:41:52.280181 10379 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:52.280293 10379 raft_consensus.cc:686] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [term 1 LEADER]: Becoming Leader. State: Replica: 026673e6bf1f43d78d841cb4279c09d4, State: Running, Role: LEADER
I20260805 22:41:52.280431 10379 consensus_queue.cc:237] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } }
I20260805 22:41:52.280990 10379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 026673e6bf1f43d78d841cb4279c09d4. Latest consensus state: current_term: 1 leader_uuid: "026673e6bf1f43d78d841cb4279c09d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } } }
I20260805 22:41:52.281139 10379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [sys.catalog]: This master's current role is: LEADER
W20260805 22:41:52.282371 10391 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:41:52.282472 10391 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:41:52.283227 10398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:52.283422 10398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:52.283638 10119 master_runner.cc:263] No leader master found from master 026673e6bf1f43d78d841cb4279c09d4
I20260805 22:41:52.283713 10119 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:41:52.285246 10318 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [term 1 FOLLOWER]: Refusing update from remote peer 026673e6bf1f43d78d841cb4279c09d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:52.285643 10379 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:52.287093 10350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 026673e6bf1f43d78d841cb4279c09d4. Latest consensus state: current_term: 1 leader_uuid: "026673e6bf1f43d78d841cb4279c09d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } } }
I20260805 22:41:52.287225 10350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:41:52.287941 10240 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [term 1 FOLLOWER]: Refusing update from remote peer 026673e6bf1f43d78d841cb4279c09d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:52.288256 10379 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:52.289650 10364 sys_catalog.cc:455] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 026673e6bf1f43d78d841cb4279c09d4. Latest consensus state: current_term: 1 leader_uuid: "026673e6bf1f43d78d841cb4279c09d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } } }
I20260805 22:41:52.289768 10364 sys_catalog.cc:458] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:41:52.290361 10379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "026673e6bf1f43d78d841cb4279c09d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } } }
I20260805 22:41:52.290452 10379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:52.290915 10350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "026673e6bf1f43d78d841cb4279c09d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } } }
I20260805 22:41:52.291005 10350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:41:52.291456 10400 mvcc.cc:205] Tried to move back new op lower bound from 7315331941517172736 to 7315331941501857792. Current Snapshot: MvccSnapshot[applied={T|T < 7315331941517172736}]
I20260805 22:41:52.292099 10404 mvcc.cc:205] Tried to move back new op lower bound from 7315331941517172736 to 7315331941501857792. Current Snapshot: MvccSnapshot[applied={T|T < 7315331941517172736}]
I20260805 22:41:52.292986 10398 catalog_manager.cc:1347] Generated new cluster ID: a8adcb6a20844a9e8e0e89230fe855c1
I20260805 22:41:52.293051 10398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:52.296646 10379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "026673e6bf1f43d78d841cb4279c09d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } } }
I20260805 22:41:52.297075 10379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:52.297763 10364 sys_catalog.cc:455] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "026673e6bf1f43d78d841cb4279c09d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026673e6bf1f43d78d841cb4279c09d4" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 39053 } } peers { permanent_uuid: "c49ca63bab414ca3bf568df67a07c951" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 45349 } } peers { permanent_uuid: "935ece20ef7b4486b10e85f0841fb188" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 41019 } } }
I20260805 22:41:52.297863 10364 sys_catalog.cc:458] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:41:52.298178 10406 mvcc.cc:205] Tried to move back new op lower bound from 7315331941517172736 to 7315331941501857792. Current Snapshot: MvccSnapshot[applied={T|T < 7315331941517172736}]
I20260805 22:41:52.303256 10347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.284490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33338 (local address 127.19.77.188:41019)
0805 22:41:52.284533 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.284535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.291394 (+ 6859us) server_negotiation.cc:407] Connection header received
0805 22:41:52.291578 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.291579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.291591 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.291623 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.293044 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.293814 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.296086 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.296408 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.296453 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.299354 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.299355 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.299356 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.299363 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.300966 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.302393 (+ 1427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.302395 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.302395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.302459 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.302641 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.302641 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.302642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.302774 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.302849 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.303029 (+ 180us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.303114 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260805 22:41:52.307982 10193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.284960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44036 (local address 127.19.77.190:39053)
0805 22:41:52.285085 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.285087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.292395 (+ 7308us) server_negotiation.cc:407] Connection header received
0805 22:41:52.292498 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.292498 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.292510 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.292541 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.293435 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.294178 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.295270 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.295593 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.295632 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.303868 (+ 8236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.303871 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.303871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.303881 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.306341 (+ 2460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.306850 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.306851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.306852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.306918 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.307135 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.307136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.307168 (+ 32us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.307316 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.307676 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.307786 (+ 110us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.307872 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":101}
I20260805 22:41:52.308650 10272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:52.285126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40168 (local address 127.19.77.189:45349)
0805 22:41:52.285178 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.285180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.299323 (+ 14143us) server_negotiation.cc:407] Connection header received
0805 22:41:52.299430 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.299431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.299442 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.299473 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.300169 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.300850 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.301875 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:52.302204 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:52.302257 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:52.303852 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:52.303854 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:52.303854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:52.303863 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:52.307311 (+ 3448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.307726 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.307727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.307728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.307789 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:52.307984 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:52.307985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:52.307985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:52.308130 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:52.308229 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:52.308466 (+ 237us) server_negotiation.cc:299] Negotiation successful
0805 22:41:52.308552 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260805 22:41:52.311517 10398 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:52.312098 10398 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:52.315619 10398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 026673e6bf1f43d78d841cb4279c09d4: Generated new TSK 0
I20260805 22:41:52.315982 10398 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:41:52.348323 10347 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.346546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33348 (local address 127.19.77.188:41019)
0805 22:41:52.346599 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.346601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.347394 (+ 793us) server_negotiation.cc:407] Connection header received
0805 22:41:52.347507 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.347508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.347521 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.347553 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.348244 (+ 691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33348: BlockingRecv error: recv got EOF from 127.0.0.1:33348 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260805 22:41:52.349372 10193 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.347026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44046 (local address 127.19.77.190:39053)
0805 22:41:52.347079 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.347081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.348787 (+ 1706us) server_negotiation.cc:407] Connection header received
0805 22:41:52.348894 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.348895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.348907 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.348937 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.349301 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44046: BlockingRecv error: recv got EOF from 127.0.0.1:44046 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260805 22:41:52.350678 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.349944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40184 (local address 127.19.77.189:45349)
0805 22:41:52.349989 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.349991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.350133 (+ 142us) server_negotiation.cc:407] Connection header received
0805 22:41:52.350230 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.350231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.350241 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.350271 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.350606 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40184: BlockingRecv error: recv got EOF from 127.0.0.1:40184 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260805 22:41:52.353549 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.352682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40196 (local address 127.19.77.189:45349)
0805 22:41:52.352722 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.352724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.352932 (+ 208us) server_negotiation.cc:407] Connection header received
0805 22:41:52.353056 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.353057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.353092 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.353123 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.353487 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40196: BlockingRecv error: recv got EOF from 127.0.0.1:40196 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260805 22:41:52.357142 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.356254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40202 (local address 127.19.77.189:45349)
0805 22:41:52.356297 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.356299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.356552 (+ 253us) server_negotiation.cc:407] Connection header received
0805 22:41:52.356662 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.356663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.356675 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.356705 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.357081 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40202: BlockingRecv error: recv got EOF from 127.0.0.1:40202 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260805 22:41:52.361752 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.360736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40212 (local address 127.19.77.189:45349)
0805 22:41:52.360790 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.360793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.361051 (+ 258us) server_negotiation.cc:407] Connection header received
0805 22:41:52.361178 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.361179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.361192 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.361225 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.361694 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40212: BlockingRecv error: recv got EOF from 127.0.0.1:40212 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260805 22:41:52.368618 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.367611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40228 (local address 127.19.77.189:45349)
0805 22:41:52.367662 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.367664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.367958 (+ 294us) server_negotiation.cc:407] Connection header received
0805 22:41:52.368070 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.368071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.368085 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.368116 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.368554 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40228: BlockingRecv error: recv got EOF from 127.0.0.1:40228 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260805 22:41:52.379410 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.378344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40238 (local address 127.19.77.189:45349)
0805 22:41:52.378392 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.378394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.378677 (+ 283us) server_negotiation.cc:407] Connection header received
0805 22:41:52.378784 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.378786 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.378798 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.378829 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.379342 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40238: BlockingRecv error: recv got EOF from 127.0.0.1:40238 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260805 22:41:52.398180 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.397172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40244 (local address 127.19.77.189:45349)
0805 22:41:52.397221 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.397223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.397516 (+ 293us) server_negotiation.cc:407] Connection header received
0805 22:41:52.397633 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.397634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.397647 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.397679 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.398117 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40244: BlockingRecv error: recv got EOF from 127.0.0.1:40244 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260805 22:41:52.432940 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.432050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40256 (local address 127.19.77.189:45349)
0805 22:41:52.432109 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.432111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.432293 (+ 182us) server_negotiation.cc:407] Connection header received
0805 22:41:52.432336 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.432337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.432351 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.432420 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.432874 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40256: BlockingRecv error: recv got EOF from 127.0.0.1:40256 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260805 22:41:52.499055 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.498194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40272 (local address 127.19.77.189:45349)
0805 22:41:52.498289 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.498291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.498400 (+ 109us) server_negotiation.cc:407] Connection header received
0805 22:41:52.498503 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.498504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.498518 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.498579 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.498973 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40272: BlockingRecv error: recv got EOF from 127.0.0.1:40272 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260805 22:41:52.629235 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.628498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40288 (local address 127.19.77.189:45349)
0805 22:41:52.628587 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.628589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.628604 (+ 15us) server_negotiation.cc:407] Connection header received
0805 22:41:52.628683 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.628684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.628695 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.628754 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.629144 (+ 390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40288: BlockingRecv error: recv got EOF from 127.0.0.1:40288 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260805 22:41:52.887359 10272 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:52.886606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40290 (local address 127.19.77.189:45349)
0805 22:41:52.886692 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:52.886694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:52.886707 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:41:52.886787 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:52.886788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:52.886799 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:52.886855 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:52.887270 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40290: BlockingRecv error: recv got EOF from 127.0.0.1:40290 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260805 22:41:53.217341 10361 catalog_manager.cc:1259] Loaded cluster ID: a8adcb6a20844a9e8e0e89230fe855c1
I20260805 22:41:53.217455 10361 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188: loading cluster ID for follower catalog manager: success
I20260805 22:41:53.218282 10361 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188: acquiring CA information for follower catalog manager: success
I20260805 22:41:53.218616 10361 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 935ece20ef7b4486b10e85f0841fb188: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:41:53.272712 10376 catalog_manager.cc:1259] Loaded cluster ID: a8adcb6a20844a9e8e0e89230fe855c1
I20260805 22:41:53.272799 10376 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951: loading cluster ID for follower catalog manager: success
I20260805 22:41:53.273698 10376 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951: acquiring CA information for follower catalog manager: success
I20260805 22:41:53.274051 10376 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c49ca63bab414ca3bf568df67a07c951: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:41:53.403419 10479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:53.400642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40296 (local address 127.19.77.189:45349)
0805 22:41:53.400782 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:53.400784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:53.400796 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:41:53.400845 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:53.400846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:53.400901 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:53.400981 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:53.401160 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:53.401680 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:53.402507 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:53.402711 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:53.402765 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:53.402949 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:53.403074 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:53.403202 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:53.403252 (+ 50us) server_negotiation.cc:299] Negotiation successful
0805 22:41:53.403275 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
I20260805 22:41:53.408119 10485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:53.405590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33358 (local address 127.19.77.188:41019)
0805 22:41:53.405719 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:53.405721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:53.405729 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:41:53.405771 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:53.405771 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:53.405812 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:53.405886 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:53.405995 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:53.406498 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:53.407303 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:53.407512 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:53.407582 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:53.407780 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:53.407895 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:53.407955 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:53.408025 (+ 70us) server_negotiation.cc:299] Negotiation successful
0805 22:41:53.408046 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
I20260805 22:41:53.413467 10493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:53.410270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44060 (local address 127.19.77.190:39053)
0805 22:41:53.410415 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:53.410418 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:53.410658 (+ 240us) server_negotiation.cc:407] Connection header received
0805 22:41:53.410712 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:53.410714 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:53.410766 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:53.410873 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:53.411012 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:53.411626 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:53.412425 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:53.412693 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:53.412763 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:53.412935 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:53.413053 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:53.413113 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:53.413308 (+ 195us) server_negotiation.cc:299] Negotiation successful
0805 22:41:53.413343 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":64,"threads_started":1}
I20260805 22:41:53.413594 10485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:53.410276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33370 (local address 127.19.77.188:41019)
0805 22:41:53.410349 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:53.410351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:53.410426 (+ 75us) server_negotiation.cc:407] Connection header received
0805 22:41:53.410517 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:53.410518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:53.410529 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:53.410589 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:53.410735 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:53.411490 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:53.412705 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:53.413028 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:53.413104 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:53.413257 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:53.413299 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:53.413358 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:53.413473 (+ 115us) server_negotiation.cc:299] Negotiation successful
0805 22:41:53.413502 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:41:53.414184 10479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:53.410198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40298 (local address 127.19.77.189:45349)
0805 22:41:53.410387 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:53.410389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:53.410398 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:53.410432 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:53.410433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:53.410445 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:53.410498 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:53.410653 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:53.411495 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:53.412736 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:53.413050 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:53.413171 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:53.413340 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:53.413374 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:53.413419 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:53.413481 (+ 62us) server_negotiation.cc:299] Negotiation successful
0805 22:41:53.413508 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260805 22:41:53.416049 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 10119
I20260805 22:41:53.423854 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 10197
I20260805 22:41:53.430980 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 10274
2026-08-05T22:41:53Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2959 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:41:53 dist-test-slave-chsk krb5kdc[10496](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:41:53 dist-test-slave-chsk krb5kdc[10496](info): set up 2 sockets
Aug 05 22:41:53 dist-test-slave-chsk krb5kdc[10496](info): commencing operation
krb5kdc: starting...
W20260805 22:41:54.503679 19766 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/test-user.keytab.
Aug 05 22:41:54 dist-test-slave-chsk krb5kdc[10496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:41:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:41:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.77.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
Entry for principal kudu/127.19.77.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab.
I20260805 22:41:54.638229 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:35861
--webserver_interface=127.19.77.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:35861,127.19.77.189:43243,127.19.77.188:35007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:41:54.724121 10509 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:41:54.724406 10509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:54.724440 10509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:54.724502 10509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:54.725777 10509 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:54.725863 10509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:54.725888 10509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:54.725908 10509 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:54.725937 10509 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:54.727600 10509 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:35861,127.19.77.189:43243,127.19.77.188:35007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.190.keytab
--principal=kudu/127.19.77.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.190:35861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.77.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:54.727922 10509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:54.728286 10509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:54.733381 10514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:54.733374 10515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:54.733649 10509 server_base.cc:1034] running on GCE node
W20260805 22:41:54.733413 10517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:54.734025 10509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:54.734421 10509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:54.735590 10509 hybrid_clock.cc:648] HybridClock initialized: now 1785969714735571 us; error 42 us; skew 500 ppm
Aug 05 22:41:54 dist-test-slave-chsk krb5kdc[10496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:54.742203 10509 init.cc:377] Logged in from keytab as kudu/127.19.77.190@KRBTEST.COM (short username kudu)
I20260805 22:41:54.742764 10509 webserver.cc:460] Webserver started at http://127.19.77.190:33033/ using document root <none> and password file <none>
I20260805 22:41:54.743046 10509 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:54.743163 10509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:54.743372 10509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:54.744650 10509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/data/instance:
uuid: "7f0286299ff140a79bd5bed87fdbb1b0"
format_stamp: "Formatted at 2026-08-05 22:41:54 on dist-test-slave-chsk"
server_key: "0b3ed3286609eba0807b1bfb0b028419"
server_key_iv: "46ddcbbf4779a486a487c73ee12ffef3"
server_key_version: "encryptionkey@0"
I20260805 22:41:54.745054 10509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/wal/instance:
uuid: "7f0286299ff140a79bd5bed87fdbb1b0"
format_stamp: "Formatted at 2026-08-05 22:41:54 on dist-test-slave-chsk"
server_key: "0b3ed3286609eba0807b1bfb0b028419"
server_key_iv: "46ddcbbf4779a486a487c73ee12ffef3"
server_key_version: "encryptionkey@0"
I20260805 22:41:54.746560 10509 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:54.747499 10524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:54.747692 10509 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:54.747808 10509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/wal
uuid: "7f0286299ff140a79bd5bed87fdbb1b0"
format_stamp: "Formatted at 2026-08-05 22:41:54 on dist-test-slave-chsk"
server_key: "0b3ed3286609eba0807b1bfb0b028419"
server_key_iv: "46ddcbbf4779a486a487c73ee12ffef3"
server_key_version: "encryptionkey@0"
I20260805 22:41:54.747892 10509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:54.772504 10509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:54.774922 10509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:54.775224 10509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:54.779664 10509 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.190:35861
I20260805 22:41:54.779708 10579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.190:35861 every 8 connection(s)
I20260805 22:41:54.780144 10509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/data/info.pb
I20260805 22:41:54.781222 10580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:54.782949 10580 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:54.785450 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 10509
I20260805 22:41:54.785581 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-0/wal/instance
I20260805 22:41:54.785812 19766 external_mini_cluster.cc:1428] Setting key 2114f9024c23c18aaa5131d12128ae33
Aug 05 22:41:54 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.77.189@KRBTEST.COM; defaulting to no policy
I20260805 22:41:54.793774 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.783780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35861 (local address 127.0.0.1:48220)
0805 22:41:54.784051 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.784099 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:54.784663 (+ 564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:54.784961 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:54.784964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:54.785288 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:54.785455 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:54.785459 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.786611 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.786612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:54.787369 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:54.787372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.787913 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.787914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:54.787977 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:54.788602 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:54.788610 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:54.790185 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:54.792167 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:54.792174 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:54.792176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:54.792387 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:54.792646 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:54.792647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:54.792647 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:54.792744 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:54.793138 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:54.793143 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:54.793207 (+ 64us) client_negotiation.cc:769] Sending connection context
0805 22:41:54.793317 (+ 110us) client_negotiation.cc:240] Negotiation successful
0805 22:41:54.793564 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":94,"thread_start_us":117,"threads_started":1}
I20260805 22:41:54.793777 10583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.783845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48220 (local address 127.19.77.190:35861)
0805 22:41:54.784076 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:54.784086 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:54.784217 (+ 131us) server_negotiation.cc:407] Connection header received
0805 22:41:54.784836 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:54.784837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:54.784854 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:54.784957 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:54.785561 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.786508 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.787469 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.787789 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.787919 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:54.790285 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:54.790293 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:54.790293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:54.790300 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:54.792028 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:54.792478 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:54.792481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:54.792482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:54.792574 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:54.792813 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:54.792814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:54.792814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:54.793056 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:54.793146 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:54.793351 (+ 205us) server_negotiation.cc:299] Negotiation successful
0805 22:41:54.793497 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":111,"threads_started":1}
I20260805 22:41:54.794621 10580 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:54.795019 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.794855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:43243 (local address 127.0.0.1:60794)
0805 22:41:54.794927 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.794984 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:43243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260805 22:41:54.795226 10526 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.77.189:43243: connect: Connection refused (error 111)
I20260805 22:41:54.795711 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.795619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:43243 (local address 127.0.0.1:60808)
0805 22:41:54.795666 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.795693 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:43243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260805 22:41:54.795838 10580 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.189:43243: Network error: Client connection negotiation failed: client connection to 127.19.77.189:43243: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab.
Entry for principal kudu/127.19.77.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab.
I20260805 22:41:54.814642 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.189:43243
--webserver_interface=127.19.77.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab
--principal=kudu/127.19.77.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:35861,127.19.77.189:43243,127.19.77.188:35007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:41:54.845104 10580 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } attempt: 1
I20260805 22:41:54.845680 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.845496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:43243 (local address 127.0.0.1:60814)
0805 22:41:54.845577 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.845632 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:43243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260805 22:41:54.846086 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.845982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:43243 (local address 127.0.0.1:60818)
0805 22:41:54.846029 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.846061 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:43243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260805 22:41:54.846230 10580 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.189:43243: Network error: Client connection negotiation failed: client connection to 127.19.77.189:43243: connect: Connection refused (error 111)
W20260805 22:41:54.903009 10587 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:41:54.903362 10587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:54.903391 10587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:54.903417 10587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:54.904706 10587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:54.904762 10587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:54.904778 10587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:54.904790 10587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:54.904803 10587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:54.906517 10587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:35861,127.19.77.189:43243,127.19.77.188:35007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.189.keytab
--principal=kudu/127.19.77.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.189:43243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.77.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:54.906831 10587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:54.907099 10587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:54.912546 10592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:54.912581 10593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:54.912560 10595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:54.912864 10587 server_base.cc:1034] running on GCE node
I20260805 22:41:54.913139 10587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:54.913501 10587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:54.914399 10580 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } attempt: 2
I20260805 22:41:54.914680 10587 hybrid_clock.cc:648] HybridClock initialized: now 1785969714914673 us; error 37 us; skew 500 ppm
I20260805 22:41:54.914925 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.914751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:43243 (local address 127.0.0.1:60822)
0805 22:41:54.914825 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.914876 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:43243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260805 22:41:54.915371 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.915246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:43243 (local address 127.0.0.1:60832)
0805 22:41:54.915302 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.915337 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.189:43243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260805 22:41:54.915494 10580 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.189:43243: Network error: Client connection negotiation failed: client connection to 127.19.77.189:43243: connect: Connection refused (error 111)
Aug 05 22:41:54 dist-test-slave-chsk krb5kdc[10496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:54.917802 10587 init.cc:377] Logged in from keytab as kudu/127.19.77.189@KRBTEST.COM (short username kudu)
I20260805 22:41:54.918339 10587 webserver.cc:460] Webserver started at http://127.19.77.189:45573/ using document root <none> and password file <none>
I20260805 22:41:54.918615 10587 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:54.918694 10587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:54.918864 10587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:54.920128 10587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/data/instance:
uuid: "f222508191c64112bbb42e2fc11a8d1e"
format_stamp: "Formatted at 2026-08-05 22:41:54 on dist-test-slave-chsk"
server_key: "5a3da90303b0c3f2b73822467929e38f"
server_key_iv: "a1bcffd78b0b0386a6b20c2ee87d5b0b"
server_key_version: "encryptionkey@0"
I20260805 22:41:54.920599 10587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/wal/instance:
uuid: "f222508191c64112bbb42e2fc11a8d1e"
format_stamp: "Formatted at 2026-08-05 22:41:54 on dist-test-slave-chsk"
server_key: "5a3da90303b0c3f2b73822467929e38f"
server_key_iv: "a1bcffd78b0b0386a6b20c2ee87d5b0b"
server_key_version: "encryptionkey@0"
I20260805 22:41:54.922179 10587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260805 22:41:54.922983 10602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:54.923245 10587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:54.923358 10587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/wal
uuid: "f222508191c64112bbb42e2fc11a8d1e"
format_stamp: "Formatted at 2026-08-05 22:41:54 on dist-test-slave-chsk"
server_key: "5a3da90303b0c3f2b73822467929e38f"
server_key_iv: "a1bcffd78b0b0386a6b20c2ee87d5b0b"
server_key_version: "encryptionkey@0"
I20260805 22:41:54.923451 10587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:54.937652 10587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:54.940335 10587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:54.940526 10587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:54.945102 10587 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.189:43243
I20260805 22:41:54.945163 10657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.189:43243 every 8 connection(s)
I20260805 22:41:54.945545 10587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/data/info.pb
I20260805 22:41:54.946642 10658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:54.948426 10658 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:54.951063 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 10587
I20260805 22:41:54.951206 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-1/wal/instance
I20260805 22:41:54.951399 19766 external_mini_cluster.cc:1428] Setting key 70178329299ae9d89d12086c5303c9a5
Aug 05 22:41:54 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:54.959034 10583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.949213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48236 (local address 127.19.77.190:35861)
0805 22:41:54.949284 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:54.949286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:54.949517 (+ 231us) server_negotiation.cc:407] Connection header received
0805 22:41:54.950018 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:54.950019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:54.950033 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:54.950091 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:54.950758 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.951371 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.952569 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.952863 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.952953 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:54.955876 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:54.955877 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:54.955878 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:54.955885 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:54.957382 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:54.957979 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:54.957979 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:54.957980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:54.958034 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:54.958348 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:54.958349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:54.958349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:54.958468 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:54.958522 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:54.958889 (+ 367us) server_negotiation.cc:299] Negotiation successful
0805 22:41:54.958964 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260805 22:41:54.959409 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.949186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35861 (local address 127.0.0.1:48236)
0805 22:41:54.949388 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.949428 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:54.949921 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:54.950175 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:54.950178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:54.950445 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:54.950667 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:54.950671 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.951503 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.951504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:54.952467 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:54.952469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.952980 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.952982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:54.953178 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:54.953782 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:54.953793 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:54.955750 (+ 1957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:54.957485 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:54.957498 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:54.957501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:54.957885 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:54.958107 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:54.958108 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:54.958109 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:54.958274 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:54.958544 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:54.958553 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:54.958743 (+ 190us) client_negotiation.cc:769] Sending connection context
0805 22:41:54.958875 (+ 132us) client_negotiation.cc:240] Negotiation successful
0805 22:41:54.959092 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":106,"threads_started":1}
I20260805 22:41:54.960168 10658 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.77.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.77.188@KRBTEST.COM" created.
Aug 05 22:41:54 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
I20260805 22:41:54.968753 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.960535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:43243 (local address 127.0.0.1:60836)
0805 22:41:54.960594 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.960606 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:54.960654 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:54.960976 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:54.960978 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:54.961153 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:54.961238 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:54.961241 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.962269 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.962271 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:54.962789 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:54.962791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.963358 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.963360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:54.963448 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:54.964043 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:54.964047 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:54.965237 (+ 1190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:54.967474 (+ 2237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:54.967475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:54.967475 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:54.967709 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:54.967945 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:54.967946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:54.967947 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:54.968019 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:54.968320 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:54.968321 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:54.968374 (+ 53us) client_negotiation.cc:769] Sending connection context
0805 22:41:54.968450 (+ 76us) client_negotiation.cc:240] Negotiation successful
0805 22:41:54.968586 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260805 22:41:54.968763 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.960618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60836 (local address 127.19.77.189:43243)
0805 22:41:54.960831 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:54.960836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:54.960851 (+ 15us) server_negotiation.cc:407] Connection header received
0805 22:41:54.960869 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:54.960870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:54.960881 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:54.960939 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:54.961338 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.962165 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.962861 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:54.963277 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:54.963336 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:54.965343 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:54.965354 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:54.965355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:54.965364 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:54.967358 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:54.967800 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:54.967804 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:54.967804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:54.967871 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:54.968085 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:54.968085 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:54.968086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:54.968251 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:54.968316 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:54.968489 (+ 173us) server_negotiation.cc:299] Negotiation successful
0805 22:41:54.968663 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":89,"server-negotiator.queue_time_us":180,"thread_start_us":137,"threads_started":1}
I20260805 22:41:54.969539 10658 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:54.969957 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.969813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49238)
0805 22:41:54.969887 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.969937 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260805 22:41:54.970116 10604 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
I20260805 22:41:54.970603 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:54.970479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49248)
0805 22:41:54.970534 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:54.970569 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260805 22:41:54.970739 10658 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35007: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.77.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab.
Entry for principal kudu/127.19.77.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab.
I20260805 22:41:54.981959 19766 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDgpMZH/build/release/bin/kudu
/tmp/dist-test-taskDgpMZH/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.188:35007
--webserver_interface=127.19.77.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab
--principal=kudu/127.19.77.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.77.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.77.190:35861,127.19.77.189:43243,127.19.77.188:35007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:41:55.006657 10580 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } attempt: 3
Aug 05 22:41:55 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
I20260805 22:41:55.014802 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.007052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:43243 (local address 127.0.0.1:60846)
0805 22:41:55.007129 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.007160 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:55.007213 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:55.007417 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:55.007418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:55.007576 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:55.007651 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.007653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.008662 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.008663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.009229 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.009231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.009758 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.009758 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.009817 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.010368 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:55.010374 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:55.011774 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:55.013757 (+ 1983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.013758 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.013759 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.013941 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.014185 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.014186 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.014186 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.014239 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.014541 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:55.014542 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:55.014587 (+ 45us) client_negotiation.cc:769] Sending connection context
0805 22:41:55.014640 (+ 53us) client_negotiation.cc:240] Negotiation successful
0805 22:41:55.014726 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260805 22:41:55.014875 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.007199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60846 (local address 127.19.77.189:43243)
0805 22:41:55.007252 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.007255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.007267 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:41:55.007300 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.007301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.007315 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.007405 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.007753 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.008542 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.009322 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.009672 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.009751 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.011890 (+ 2139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.011892 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.011893 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.011902 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.013650 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.014029 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.014030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.014031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.014108 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.014304 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.014305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.014305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.014472 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.014546 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.014685 (+ 139us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.014779 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260805 22:41:55.015517 10580 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:55.015909 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.015793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49252)
0805 22:41:55.015845 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.015882 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260805 22:41:55.016250 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.016168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49264)
0805 22:41:55.016212 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.016236 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260805 22:41:55.016367 10580 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35007: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
I20260805 22:41:55.020053 10658 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } attempt: 1
I20260805 22:41:55.020612 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.020449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49268)
0805 22:41:55.020521 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.020574 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 22:41:55.021072 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.020964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49284)
0805 22:41:55.021015 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.021047 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260805 22:41:55.021245 10658 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35007: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
I20260805 22:41:55.047544 10580 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } attempt: 1
I20260805 22:41:55.048126 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.047960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49294)
0805 22:41:55.048033 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.048087 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260805 22:41:55.048553 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.048449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49298)
0805 22:41:55.048494 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.048525 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260805 22:41:55.048717 10580 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35007: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
W20260805 22:41:55.075314 10666 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:41:55.075548 10666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:41:55.075567 10666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:41:55.075592 10666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:41:55.076751 10666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:41:55.076794 10666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:41:55.076809 10666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:41:55.076821 10666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:41:55.076834 10666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:41:55.078353 10666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.77.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.77.190:35861,127.19.77.189:43243,127.19.77.188:35007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/krb5kdc/kudu_127.19.77.188.keytab
--principal=kudu/127.19.77.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.77.188:35007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.77.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 05 Aug 2026 21:53:01 UTC on ccycloud.quasar-phufqb.root.comops.site
build id 4569240
I20260805 22:41:55.078574 10666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:41:55.078770 10666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:41:55.083920 10672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:55.083978 10674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:41:55.083920 10671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:41:55.084306 10666 server_base.cc:1034] running on GCE node
I20260805 22:41:55.084543 10666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:41:55.084817 10666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:41:55.085974 10666 hybrid_clock.cc:648] HybridClock initialized: now 1785969715085960 us; error 41 us; skew 500 ppm
Aug 05 22:41:55 dist-test-slave-chsk krb5kdc[10496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969715, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:41:55.088811 10666 init.cc:377] Logged in from keytab as kudu/127.19.77.188@KRBTEST.COM (short username kudu)
I20260805 22:41:55.089389 10666 webserver.cc:460] Webserver started at http://127.19.77.188:34531/ using document root <none> and password file <none>
I20260805 22:41:55.089425 10658 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } attempt: 2
I20260805 22:41:55.089708 10666 fs_manager.cc:359] Metadata directory not provided
I20260805 22:41:55.089798 10666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:41:55.089874 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.089718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49302)
0805 22:41:55.089791 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.089834 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 22:41:55.089959 10666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:41:55.090484 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.090329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49312)
0805 22:41:55.090419 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.090456 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260805 22:41:55.090646 10658 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.77.188:35007: Network error: Client connection negotiation failed: client connection to 127.19.77.188:35007: connect: Connection refused (error 111)
I20260805 22:41:55.091354 10666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/data/instance:
uuid: "24603b59189a4040a75ee6fa9a833afb"
format_stamp: "Formatted at 2026-08-05 22:41:55 on dist-test-slave-chsk"
server_key: "f52c4b07e3991ed7d86c63964fe5687e"
server_key_iv: "d14e9d2e89b355fdb5a32a08629b4733"
server_key_version: "encryptionkey@0"
I20260805 22:41:55.091676 10666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/wal/instance:
uuid: "24603b59189a4040a75ee6fa9a833afb"
format_stamp: "Formatted at 2026-08-05 22:41:55 on dist-test-slave-chsk"
server_key: "f52c4b07e3991ed7d86c63964fe5687e"
server_key_iv: "d14e9d2e89b355fdb5a32a08629b4733"
server_key_version: "encryptionkey@0"
I20260805 22:41:55.093094 10666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260805 22:41:55.093876 10681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:41:55.094120 10666 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 22:41:55.094235 10666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/data,/tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/wal
uuid: "24603b59189a4040a75ee6fa9a833afb"
format_stamp: "Formatted at 2026-08-05 22:41:55 on dist-test-slave-chsk"
server_key: "f52c4b07e3991ed7d86c63964fe5687e"
server_key_iv: "d14e9d2e89b355fdb5a32a08629b4733"
server_key_version: "encryptionkey@0"
I20260805 22:41:55.094323 10666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:41:55.111749 10666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:41:55.113948 10666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:41:55.114125 10666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:41:55.118784 10666 rpc_server.cc:307] RPC server started. Bound to: 127.19.77.188:35007
I20260805 22:41:55.118861 10734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.77.188:35007 every 8 connection(s)
I20260805 22:41:55.119316 10666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/data/info.pb
I20260805 22:41:55.120399 10735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:41:55.122134 10735 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:55.123874 10580 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } attempt: 2
I20260805 22:41:55.128583 19766 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDgpMZH/build/release/bin/kudu as pid 10666
I20260805 22:41:55.128710 19766 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDgpMZH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785969428667539-19766-0/minicluster-data/master-2/wal/instance
I20260805 22:41:55.128988 19766 external_mini_cluster.cc:1428] Setting key df06612dc9b334fdf24649bc65cf4254
Aug 05 22:41:55 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.190@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
Aug 05 22:41:55 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969715, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:55.134048 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.124160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49320)
0805 22:41:55.124220 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.124232 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:55.124278 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:55.124605 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:55.124606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:55.124778 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:55.124826 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.124827 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.126096 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.126097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.126903 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.126906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.127524 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.127525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.127597 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.127878 (+ 281us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:55.127883 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:55.130229 (+ 2346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:55.132477 (+ 2248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.132478 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.132479 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.132789 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.133088 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.133088 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.133089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.133159 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.133629 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:55.133630 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:55.133681 (+ 51us) client_negotiation.cc:769] Sending connection context
0805 22:41:55.133812 (+ 131us) client_negotiation.cc:240] Negotiation successful
0805 22:41:55.133929 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260805 22:41:55.134269 10738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.124268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49320 (local address 127.19.77.188:35007)
0805 22:41:55.124452 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.124456 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.124471 (+ 15us) server_negotiation.cc:407] Connection header received
0805 22:41:55.124490 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.124492 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.124508 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.124569 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.124917 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.126012 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.126987 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.127391 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.127500 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.130330 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.130337 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.130338 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.130345 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.132370 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.132886 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.132891 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.132891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.133022 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.133227 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.133228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.133228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.133548 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.133652 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.133888 (+ 236us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.134028 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":99,"threads_started":1}
I20260805 22:41:55.134649 10583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.122949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48244 (local address 127.19.77.190:35861)
0805 22:41:55.123042 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.123044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.123303 (+ 259us) server_negotiation.cc:407] Connection header received
0805 22:41:55.123798 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.123800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.123812 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.123876 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.124727 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.125474 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.126664 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.126909 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.126985 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.130416 (+ 3431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.130418 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.130418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.130426 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.132961 (+ 2535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.133690 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.133691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.133691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.133757 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.133992 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.133993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.133993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.134146 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.134200 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.134443 (+ 243us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.134530 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260805 22:41:55.135023 10737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.122889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.190:35861 (local address 127.0.0.1:48244)
0805 22:41:55.123123 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.123216 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:55.123708 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:55.123956 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:55.123961 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:55.124380 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:55.124626 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.124634 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.125570 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.125571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.126580 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.126583 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.127037 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.127038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.127214 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.127835 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:55.127846 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:55.130327 (+ 2481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:55.133051 (+ 2724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.133060 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.133063 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.133346 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.133844 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.133845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.133845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.133913 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.134260 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:55.134268 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:55.134318 (+ 50us) client_negotiation.cc:769] Sending connection context
0805 22:41:55.134781 (+ 463us) client_negotiation.cc:240] Negotiation successful
0805 22:41:55.134918 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":127,"threads_started":1}
Aug 05 22:41:55 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
I20260805 22:41:55.136178 10580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0: Bootstrap starting.
I20260805 22:41:55.136948 10580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:55.137261 10580 log.cc:824] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:55.137836 10735 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:55.138237 10580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0: No bootstrap required, opened a new log
I20260805 22:41:55.140447 10580 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } }
I20260805 22:41:55.140578 10580 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0286299ff140a79bd5bed87fdbb1b0, State: Initialized, Role: FOLLOWER
I20260805 22:41:55.140662 10740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.129422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49332 (local address 127.19.77.188:35007)
0805 22:41:55.129596 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.129598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.129683 (+ 85us) server_negotiation.cc:407] Connection header received
0805 22:41:55.129754 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.129755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.129764 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.129820 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.130690 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.131520 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.132673 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.132986 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.133068 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.136196 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.136198 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.136198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.136207 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.138599 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.139003 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.139003 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.139004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.139058 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.139322 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.139323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.139323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.139474 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.139639 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.140412 (+ 773us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.140498 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":110,"threads_started":1}
I20260805 22:41:55.140683 10580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } }
I20260805 22:41:55.141072 10580 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:55.141054 10743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } } }
I20260805 22:41:55.141232 10743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:41:55.143082 10754 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:41:55.143184 10754 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 05 22:41:55 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969715, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
I20260805 22:41:55.146890 10737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.138169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.189:43243 (local address 127.0.0.1:60848)
0805 22:41:55.139214 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.139226 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:55.139298 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:55.139440 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:55.139441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:55.139595 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:55.139640 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.139642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.140371 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.140372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.141409 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.141412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.141820 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.141821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.141882 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.142410 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:55.142416 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:55.143774 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:55.145740 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.145742 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.145742 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.145962 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.146187 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.146188 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.146188 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.146249 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.146557 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:55.146558 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:55.146608 (+ 50us) client_negotiation.cc:769] Sending connection context
0805 22:41:55.146673 (+ 65us) client_negotiation.cc:240] Negotiation successful
0805 22:41:55.146777 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1026}
I20260805 22:41:55.147341 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.138261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60848 (local address 127.19.77.189:43243)
0805 22:41:55.138342 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.138344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.139289 (+ 945us) server_negotiation.cc:407] Connection header received
0805 22:41:55.139358 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.139359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.139372 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.139436 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.139719 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.140290 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.141515 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.141739 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.141823 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.143864 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.143865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.143866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.143875 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.145635 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.146050 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.146052 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.146052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.146115 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.146317 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.146317 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.146318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.146452 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.146515 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.147070 (+ 555us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.147215 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 05 22:41:55 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.190@KRBTEST.COM
I20260805 22:41:55.149315 10735 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:41:55.146373 10509 master_runner.cc:186] Error getting master registration for 127.19.77.189:43243: OK, instance_id { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" instance_seqno: 1785969714943840 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:41:55.150633 10509 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:41:55.151409 10583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.141379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48260 (local address 127.19.77.190:35861)
0805 22:41:55.142576 (+ 1197us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.142578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.142588 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:55.142610 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.142611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.142622 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.143389 (+ 767us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.143420 (+ 31us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.143996 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.144936 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.145204 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.145271 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.148052 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.148054 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.148055 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.148064 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.149851 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.150298 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.150299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.150300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.150377 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.150606 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.150607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.150607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.150739 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.150878 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.151233 (+ 355us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.151323 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1174}
Aug 05 22:41:55 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969715, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.188@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
Aug 05 22:41:55 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.77.189@KRBTEST.COM
I20260805 22:41:55.157681 10737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.149576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49340)
0805 22:41:55.149640 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.149653 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:55.149703 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:55.150083 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:55.150084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:55.150269 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:55.150322 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.150325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.151276 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.151277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.152140 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.152143 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.152678 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.152679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.152746 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.153217 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:55.153222 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:55.154796 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:55.156551 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.156553 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.156553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.156733 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.156946 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.156947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.156948 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.157004 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.157335 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:55.157335 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:55.157376 (+ 41us) client_negotiation.cc:769] Sending connection context
0805 22:41:55.157447 (+ 71us) client_negotiation.cc:240] Negotiation successful
0805 22:41:55.157562 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260805 22:41:55.157732 10740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.149684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49340 (local address 127.19.77.188:35007)
0805 22:41:55.149956 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.149958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.149965 (+ 7us) server_negotiation.cc:407] Connection header received
0805 22:41:55.149985 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.149986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.149998 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.150389 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.150411 (+ 22us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.151131 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.152226 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.152595 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.152667 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.154888 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.154889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.154889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.154896 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.156443 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.156818 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.156819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.156820 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.156871 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.157092 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.157093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.157093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.157267 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.157345 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.157490 (+ 145us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.157622 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":251}
I20260805 22:41:55.159439 10735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb: Bootstrap starting.
I20260805 22:41:55.160264 10735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:55.160682 10735 log.cc:824] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:55.160755 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.151984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60862 (local address 127.19.77.189:43243)
0805 22:41:55.152023 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.152025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.152033 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:41:55.152057 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.152058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.152067 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.152131 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.152734 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.153402 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.154298 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.154710 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.154782 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.157579 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.157580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.157581 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.157589 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.159303 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.159795 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.159796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.159797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.159859 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.160085 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.160086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.160087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.160230 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.160399 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.160564 (+ 165us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.160655 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260805 22:41:55.161793 10735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb: No bootstrap required, opened a new log
I20260805 22:41:55.162297 19766 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:41:55.163300 10552 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7f0286299ff140a79bd5bed87fdbb1b0"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48260
I20260805 22:41:55.163456 10552 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260805 22:41:55.163503 10552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:55.164136 10735 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } }
I20260805 22:41:55.164294 10735 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24603b59189a4040a75ee6fa9a833afb, State: Initialized, Role: FOLLOWER
I20260805 22:41:55.164386 10735 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } }
I20260805 22:41:55.164510 10552 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } }
I20260805 22:41:55.164773 10552 leader_election.cc:288] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [CANDIDATE]: Term 1 election: Requested vote from peers f222508191c64112bbb42e2fc11a8d1e (127.19.77.189:43243), 24603b59189a4040a75ee6fa9a833afb (127.19.77.188:35007)
I20260805 22:41:55.164783 10735 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:55.165122 10709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "24603b59189a4040a75ee6fa9a833afb"
I20260805 22:41:55.166054 10709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:55.167394 10709 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0286299ff140a79bd5bed87fdbb1b0 in term 1.
I20260805 22:41:55.167659 10526 leader_election.cc:302] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24603b59189a4040a75ee6fa9a833afb, 7f0286299ff140a79bd5bed87fdbb1b0; no voters:
I20260805 22:41:55.167817 10743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:41:55.167985 10743 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [term 1 LEADER]: Becoming Leader. State: Replica: 7f0286299ff140a79bd5bed87fdbb1b0, State: Running, Role: LEADER
I20260805 22:41:55.168094 10743 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } }
I20260805 22:41:55.164740 10757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } } }
W20260805 22:41:55.168594 10775 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260805 22:41:55.168766 10757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:41:55.168807 10775 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:41:55.168874 10776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f0286299ff140a79bd5bed87fdbb1b0. Latest consensus state: current_term: 1 leader_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } } }
I20260805 22:41:55.168979 10776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:55.170377 10666 master_runner.cc:186] Error getting master registration for 127.19.77.189:43243: OK, instance_id { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" instance_seqno: 1785969714943840 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:41:55.172837 10666 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:41:55.175385 10779 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:41:55.175659 10779 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:41:55.181784 10658 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } attempt: 3
I20260805 22:41:55.182593 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.166697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60870 (local address 127.19.77.189:43243)
0805 22:41:55.166842 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.166844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.171467 (+ 4623us) server_negotiation.cc:407] Connection header received
0805 22:41:55.171565 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.171566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.171577 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.171625 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.172964 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.173685 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.175305 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.175643 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.175688 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.178132 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.178134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.178135 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.178143 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.179969 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.180644 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.180645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.180646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.180728 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.181062 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.181064 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.181064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.181212 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.181289 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.181646 (+ 357us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.181746 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260805 22:41:55.187798 10740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.166747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49348 (local address 127.19.77.188:35007)
0805 22:41:55.166871 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.166873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.180434 (+ 13561us) server_negotiation.cc:407] Connection header received
0805 22:41:55.180549 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.180550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.180563 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.180598 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.181293 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.182005 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.182987 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.183317 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.183366 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.184790 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.184791 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.184791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.184801 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.186410 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.186831 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.186832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.186833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.186903 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.187132 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.187133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.187133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.187341 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.187440 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.187582 (+ 142us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.187677 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
Aug 05 22:41:55 dist-test-slave-chsk krb5kdc[10496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785969714, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.77.189@KRBTEST.COM for kudu/127.19.77.188@KRBTEST.COM
I20260805 22:41:55.189961 10583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.166642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48272 (local address 127.19.77.190:35861)
0805 22:41:55.166804 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.166806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.171301 (+ 4495us) server_negotiation.cc:407] Connection header received
0805 22:41:55.171386 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.171387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.171400 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.171456 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.172280 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.173071 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.180213 (+ 7142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.180535 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.180630 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.182283 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.182285 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.182286 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.182295 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.184439 (+ 2144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.189043 (+ 4604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.189045 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.189046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.189122 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.189326 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.189327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.189327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.189465 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.189550 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.189766 (+ 216us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.189859 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260805 22:41:55.192044 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.182170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.77.188:35007 (local address 127.0.0.1:49356)
0805 22:41:55.182374 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 22:41:55.182386 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0805 22:41:55.182429 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:41:55.182882 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:41:55.182883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:41:55.183039 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:41:55.183083 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.183085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.184510 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.184511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.185846 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:41:55.185850 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.186444 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.186445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:41:55.186504 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.186908 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:41:55.186913 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:41:55.188636 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:41:55.190736 (+ 2100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.190738 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.190739 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.190978 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.191293 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:41:55.191293 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:41:55.191294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:41:55.191367 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:41:55.191700 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:41:55.191701 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:41:55.191762 (+ 61us) client_negotiation.cc:769] Sending connection context
0805 22:41:55.191828 (+ 66us) client_negotiation.cc:240] Negotiation successful
0805 22:41:55.191940 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183}
I20260805 22:41:55.192241 10709 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [term 1 FOLLOWER]: Refusing update from remote peer 7f0286299ff140a79bd5bed87fdbb1b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:55.192446 10738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:55.182377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49356 (local address 127.19.77.188:35007)
0805 22:41:55.182422 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.182424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.182432 (+ 8us) server_negotiation.cc:407] Connection header received
0805 22:41:55.182491 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.182492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.182502 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.182832 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.183200 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.184403 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.185945 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:55.186321 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:55.186385 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:55.188727 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:41:55.188728 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:41:55.188729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:41:55.188736 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:41:55.190616 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.191075 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.191076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.191077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.191197 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:41:55.191444 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:41:55.191445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:41:55.191445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:41:55.191600 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:41:55.191659 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:55.192268 (+ 609us) server_negotiation.cc:299] Negotiation successful
0805 22:41:55.192356 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:41:55.192608 10776 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:55.194023 10658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e: Bootstrap starting.
I20260805 22:41:55.194844 10658 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e: Neither blocks nor log segments found. Creating new log.
I20260805 22:41:55.195209 10658 log.cc:824] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:41:55.196732 10757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f0286299ff140a79bd5bed87fdbb1b0. Latest consensus state: current_term: 1 leader_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } } }
I20260805 22:41:55.196853 10757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:41:55.198330 10743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } } }
I20260805 22:41:55.198432 10743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:55.198886 10757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } } }
I20260805 22:41:55.198977 10757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:41:55.198920 10779 catalog_manager.cc:1347] Generated new cluster ID: 606c56347c8a43edb0827e3b6e82801d
I20260805 22:41:55.199040 10779 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:41:55.199509 10780 mvcc.cc:205] Tried to move back new op lower bound from 7315331953424601088 to 7315331953329369088. Current Snapshot: MvccSnapshot[applied={T|T < 7315331953424601088 or (T in {7315331953424601088})}]
I20260805 22:41:55.199867 10658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e: No bootstrap required, opened a new log
I20260805 22:41:55.201993 10658 raft_consensus.cc:348] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } }
I20260805 22:41:55.202176 10658 raft_consensus.cc:729] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f222508191c64112bbb42e2fc11a8d1e, State: Initialized, Role: FOLLOWER
I20260805 22:41:55.202265 10658 consensus_queue.cc:260] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } }
I20260805 22:41:55.202651 10658 sys_catalog.cc:564] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:41:55.202723 10630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f222508191c64112bbb42e2fc11a8d1e"
I20260805 22:41:55.202821 10630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:41:55.204037 10630 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0286299ff140a79bd5bed87fdbb1b0 in term 1.
I20260805 22:41:55.204305 10629 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [term 1 FOLLOWER]: Refusing update from remote peer 7f0286299ff140a79bd5bed87fdbb1b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:41:55.204567 10776 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:41:55.204694 10782 mvcc.cc:205] Tried to move back new op lower bound from 7315331953424601088 to 7315331953329369088. Current Snapshot: MvccSnapshot[applied={T|T < 7315331953424601088}]
I20260805 22:41:55.206563 10799 sys_catalog.cc:455] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } } }
I20260805 22:41:55.206691 10799 sys_catalog.cc:458] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:41:55.206745 10799 sys_catalog.cc:455] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } } }
I20260805 22:41:55.206785 10799 sys_catalog.cc:458] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:41:55.206952 10803 sys_catalog.cc:455] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f0286299ff140a79bd5bed87fdbb1b0. Latest consensus state: current_term: 1 leader_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } } }
I20260805 22:41:55.207067 10803 sys_catalog.cc:458] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:41:55.207782 10797 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:41:55.207836 10797 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:41:55.220832 10776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0286299ff140a79bd5bed87fdbb1b0" member_type: VOTER last_known_addr { host: "127.19.77.190" port: 35861 } } peers { permanent_uuid: "f222508191c64112bbb42e2fc11a8d1e" member_type: VOTER last_known_addr { host: "127.19.77.189" port: 43243 } } peers { permanent_uuid: "24603b59189a4040a75ee6fa9a833afb" member_type: VOTER last_known_addr { host: "127.19.77.188" port: 35007 } } }
I20260805 22:41:55.220974 10776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0 [sys.catalog]: This master's current role is: LEADER
I20260805 22:41:55.223232 10779 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:41:55.224076 10779 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:41:55.243225 10779 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f0286299ff140a79bd5bed87fdbb1b0: Generated new TSK 0
I20260805 22:41:55.243546 10779 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:41:55.272393 10583 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.270677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48276 (local address 127.19.77.190:35861)
0805 22:41:55.270723 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.270725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.271674 (+ 949us) server_negotiation.cc:407] Connection header received
0805 22:41:55.271784 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.271785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.271796 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.271828 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.272312 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48276: BlockingRecv error: recv got EOF from 127.0.0.1:48276 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260805 22:41:55.273365 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.271066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60874 (local address 127.19.77.189:43243)
0805 22:41:55.271108 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.271110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.272835 (+ 1725us) server_negotiation.cc:407] Connection header received
0805 22:41:55.272933 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.272934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.272944 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.272973 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.273298 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60874: BlockingRecv error: recv got EOF from 127.0.0.1:60874 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260805 22:41:55.274379 10738 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.271390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49366 (local address 127.19.77.188:35007)
0805 22:41:55.271431 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.271433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.273732 (+ 2299us) server_negotiation.cc:407] Connection header received
0805 22:41:55.273916 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.273917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.273929 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.273960 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.274316 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49366: BlockingRecv error: recv got EOF from 127.0.0.1:49366 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260805 22:41:55.277441 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.276603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60878 (local address 127.19.77.189:43243)
0805 22:41:55.276644 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.276646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.276864 (+ 218us) server_negotiation.cc:407] Connection header received
0805 22:41:55.276983 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.276984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.277005 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.277036 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.277382 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60878: BlockingRecv error: recv got EOF from 127.0.0.1:60878 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260805 22:41:55.280881 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.280032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60890 (local address 127.19.77.189:43243)
0805 22:41:55.280072 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.280074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.280322 (+ 248us) server_negotiation.cc:407] Connection header received
0805 22:41:55.280424 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.280425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.280436 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.280466 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.280826 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60890: BlockingRecv error: recv got EOF from 127.0.0.1:60890 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260805 22:41:55.285241 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.284350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60894 (local address 127.19.77.189:43243)
0805 22:41:55.284400 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.284402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.284667 (+ 265us) server_negotiation.cc:407] Connection header received
0805 22:41:55.284770 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.284771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.284783 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.284814 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.285183 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60894: BlockingRecv error: recv got EOF from 127.0.0.1:60894 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260805 22:41:55.291821 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.290833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60896 (local address 127.19.77.189:43243)
0805 22:41:55.290878 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.290881 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.291186 (+ 305us) server_negotiation.cc:407] Connection header received
0805 22:41:55.291300 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.291302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.291314 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.291344 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.291757 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60896: BlockingRecv error: recv got EOF from 127.0.0.1:60896 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260805 22:41:55.302515 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.301483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60912 (local address 127.19.77.189:43243)
0805 22:41:55.301544 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.301546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.301831 (+ 285us) server_negotiation.cc:407] Connection header received
0805 22:41:55.301933 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.301935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.301965 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.301998 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.302453 (+ 455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60912: BlockingRecv error: recv got EOF from 127.0.0.1:60912 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260805 22:41:55.321319 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.320251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60922 (local address 127.19.77.189:43243)
0805 22:41:55.320302 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.320304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.320627 (+ 323us) server_negotiation.cc:407] Connection header received
0805 22:41:55.320744 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.320745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.320758 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.320791 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.321253 (+ 462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60922: BlockingRecv error: recv got EOF from 127.0.0.1:60922 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260805 22:41:55.360172 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.355015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60938 (local address 127.19.77.189:43243)
0805 22:41:55.355079 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.355081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.359426 (+ 4345us) server_negotiation.cc:407] Connection header received
0805 22:41:55.359578 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.359580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.359595 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.359629 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.360104 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60938: BlockingRecv error: recv got EOF from 127.0.0.1:60938 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260805 22:41:55.426539 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.425773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60950 (local address 127.19.77.189:43243)
0805 22:41:55.425832 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.425834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.425943 (+ 109us) server_negotiation.cc:407] Connection header received
0805 22:41:55.426013 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.426014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.426034 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.426092 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.426462 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60950: BlockingRecv error: recv got EOF from 127.0.0.1:60950 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260805 22:41:55.556782 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.555940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60964 (local address 127.19.77.189:43243)
0805 22:41:55.556027 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.556037 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.556143 (+ 106us) server_negotiation.cc:407] Connection header received
0805 22:41:55.556267 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.556268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.556280 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.556349 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.556720 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60964: BlockingRecv error: recv got EOF from 127.0.0.1:60964 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260805 22:41:55.815094 10662 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:41:55.814418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60968 (local address 127.19.77.189:43243)
0805 22:41:55.814502 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:55.814505 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:55.814514 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:55.814549 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:55.814550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:55.814560 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:55.814629 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:41:55.815004 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60968: BlockingRecv error: recv got EOF from 127.0.0.1:60968 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 22:41:56.169312 10775 catalog_manager.cc:1259] Loaded cluster ID: 606c56347c8a43edb0827e3b6e82801d
I20260805 22:41:56.169409 10775 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb: loading cluster ID for follower catalog manager: success
I20260805 22:41:56.170272 10775 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb: acquiring CA information for follower catalog manager: success
I20260805 22:41:56.170606 10775 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 24603b59189a4040a75ee6fa9a833afb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:41:56.208335 10797 catalog_manager.cc:1259] Loaded cluster ID: 606c56347c8a43edb0827e3b6e82801d
I20260805 22:41:56.208428 10797 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e: loading cluster ID for follower catalog manager: success
I20260805 22:41:56.209236 10797 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e: acquiring CA information for follower catalog manager: success
I20260805 22:41:56.209513 10797 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f222508191c64112bbb42e2fc11a8d1e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:41:56.331220 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:56.328415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60976 (local address 127.19.77.189:43243)
0805 22:41:56.328561 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:56.328563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:56.328575 (+ 12us) server_negotiation.cc:407] Connection header received
0805 22:41:56.328675 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:56.328676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:56.328742 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:56.328834 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:56.328991 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:56.329531 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:56.330331 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:56.330538 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:56.330617 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:56.330810 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:56.330927 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:56.331030 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:56.331050 (+ 20us) server_negotiation.cc:299] Negotiation successful
0805 22:41:56.331073 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260805 22:41:56.335554 10878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:56.333144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49378 (local address 127.19.77.188:35007)
0805 22:41:56.333277 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:56.333279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:56.333288 (+ 9us) server_negotiation.cc:407] Connection header received
0805 22:41:56.333330 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:56.333330 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:56.333370 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:56.333441 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:56.333541 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:56.334043 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:56.334819 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:56.335007 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:56.335061 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:56.335251 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:56.335359 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:56.335419 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:56.335464 (+ 45us) server_negotiation.cc:299] Negotiation successful
0805 22:41:56.335484 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":82,"threads_started":1}
I20260805 22:41:56.340786 10878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:56.337767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49388 (local address 127.19.77.188:35007)
0805 22:41:56.337811 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:56.337813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:56.337954 (+ 141us) server_negotiation.cc:407] Connection header received
0805 22:41:56.338075 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:56.338077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:56.338088 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:56.338162 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:56.338314 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:56.338795 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:56.340002 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:56.340218 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:56.340298 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:56.340452 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:56.340488 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:56.340543 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:56.340656 (+ 113us) server_negotiation.cc:299] Negotiation successful
0805 22:41:56.340684 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260805 22:41:56.340839 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:56.337584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60992 (local address 127.19.77.189:43243)
0805 22:41:56.337679 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:56.337681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:56.337830 (+ 149us) server_negotiation.cc:407] Connection header received
0805 22:41:56.337864 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:56.337865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:56.337879 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:56.337938 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:56.338079 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:56.338810 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:56.339721 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:56.339948 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:56.340017 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:56.340487 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:56.340555 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:56.340612 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:56.340699 (+ 87us) server_negotiation.cc:299] Negotiation successful
0805 22:41:56.340734 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260805 22:41:56.340941 10884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:41:56.337413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48280 (local address 127.19.77.190:35861)
0805 22:41:56.337556 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0805 22:41:56.337558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0805 22:41:56.337568 (+ 10us) server_negotiation.cc:407] Connection header received
0805 22:41:56.337620 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:41:56.337621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:41:56.337680 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:41:56.337770 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:41:56.337935 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:56.338759 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:56.339969 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:41:56.340221 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:41:56.340302 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:41:56.340534 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:41:56.340671 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:41:56.340712 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0805 22:41:56.340825 (+ 113us) server_negotiation.cc:299] Negotiation successful
0805 22:41:56.340852 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":56,"threads_started":1}
I20260805 22:41:56.343029 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 10509
I20260805 22:41:56.350481 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 10587
I20260805 22:41:56.357395 19766 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDgpMZH/build/release/bin/kudu with pid 10666
2026-08-05T22:41:56Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2926 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5886 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (287698 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST